-- Logs begin at Mon 2022-10-03 11:56:13 UTC, end at Mon 2022-10-03 13:00:39 UTC. -- Oct 03 12:23:31.589218 dv-cinder-844563-12-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 03 12:23:31.597377 dv-cinder-844563-12-smb devstack@keystone.service[81397]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 3 12:23:31 2022] *** Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: nodename: dv-cinder-844563-12-smb Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: machine: x86_64 Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: clock source: unix Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: pcre jit disabled Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: detected number of CPU cores: 4 Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: current working directory: / Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: detected binary path: /usr/bin/uwsgi-core Oct 03 12:23:31.599430 dv-cinder-844563-12-smb devstack@keystone.service[81397]: your processes number limit is 47680 Oct 03 12:23:31.600766 dv-cinder-844563-12-smb devstack@keystone.service[81397]: your memory page size is 4096 bytes Oct 03 12:23:31.600766 dv-cinder-844563-12-smb devstack@keystone.service[81397]: detected max file descriptor number: 2048 Oct 03 12:23:31.600766 dv-cinder-844563-12-smb devstack@keystone.service[81397]: lock engine: pthread robust mutexes Oct 03 12:23:31.600766 dv-cinder-844563-12-smb devstack@keystone.service[81397]: thunder lock: enabled Oct 03 12:23:31.600766 dv-cinder-844563-12-smb devstack@keystone.service[81397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 03 12:23:31.600766 dv-cinder-844563-12-smb devstack@keystone.service[81397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 03 12:23:31.638670 dv-cinder-844563-12-smb devstack@keystone.service[81397]: Python main interpreter initialized at 0x555b148049c0 Oct 03 12:23:31.638670 dv-cinder-844563-12-smb devstack@keystone.service[81397]: python threads support enabled Oct 03 12:23:31.638670 dv-cinder-844563-12-smb devstack@keystone.service[81397]: your server socket listen backlog is limited to 100 connections Oct 03 12:23:31.638670 dv-cinder-844563-12-smb devstack@keystone.service[81397]: your mercy for graceful operations on workers is 90 seconds Oct 03 12:23:31.639070 dv-cinder-844563-12-smb devstack@keystone.service[81397]: mapped 403077 bytes (393 KB) for 2 cores Oct 03 12:23:31.639148 dv-cinder-844563-12-smb devstack@keystone.service[81397]: *** Operational MODE: preforking *** Oct 03 12:23:31.639365 dv-cinder-844563-12-smb devstack@keystone.service[81397]: *** uWSGI is running in multiple interpreter mode *** Oct 03 12:23:31.639365 dv-cinder-844563-12-smb devstack@keystone.service[81397]: spawned uWSGI master process (pid: 81397) Oct 03 12:23:31.639569 dv-cinder-844563-12-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 03 12:23:31.640968 dv-cinder-844563-12-smb devstack@keystone.service[81397]: spawned uWSGI worker 1 (pid: 81412, cores: 1) Oct 03 12:23:31.640968 dv-cinder-844563-12-smb devstack@keystone.service[81397]: spawned uWSGI worker 2 (pid: 81413, cores: 1) Oct 03 12:23:31.640968 dv-cinder-844563-12-smb devstack@keystone.service[81397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 03 12:23:35.940443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:23:35.940443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: from cryptography.utils import int_from_bytes Oct 03 12:23:35.941289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:23:35.941289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: from cryptography.utils import int_from_bytes Oct 03 12:23:35.941419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:23:35.941419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: from cryptography.utils import int_from_bytes Oct 03 12:23:35.941886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 03 12:23:35.941886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: from cryptography.utils import int_from_bytes Oct 03 12:23:35.990672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 12:23:35.990852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 12:23:35.991033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] command line args: [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 12:23:35.991306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 12:23:35.991485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ================================================================================ {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 12:23:35.991574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 03 12:23:35.991689 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 03 12:23:35.991771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] admin_token = **** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.991902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] command line args: [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 03 12:23:35.992041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] config_dir = [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.992134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.992213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 03 12:23:35.992298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] config_source = [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.992381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ================================================================================ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 03 12:23:35.992468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] debug = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.992580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] admin_token = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.992676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.992945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] config_dir = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] config_source = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] debug = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.993892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] list_limit = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] log_config_append = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] log_dir = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] log_file = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.994967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_config_append = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_dir = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_file = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.995995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.996934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.997038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.997133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.997241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.997338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.997446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.997578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.997692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.997795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.998202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.998321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.998510 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.998709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.998856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.998998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] publish_errors = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.999102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.999246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.999376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.999505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.999614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.999754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] publish_errors = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.999876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:35.999998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] standard_threads = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.000932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] use_journal = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] standard_threads = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] use_json = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] use_stderr = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] use_syslog = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_journal = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.001904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.002023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_json = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.002099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_stderr = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.002179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.002253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] use_syslog = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.002376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.002464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 03 12:23:36.002619 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.002705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.002871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.002951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.003110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.003190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.003359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.003438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.003595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.003676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.003843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.003922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.004090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.004178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.004342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.004423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.004574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.004654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.004821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.004901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.005057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.005139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.005293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.005371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.005556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.005650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.005799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.005879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.006052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.006132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.006302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.006392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.006546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.006621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.006769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.006853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.007998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.008085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.008229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.008312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.008458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.008550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.008693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.008774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.008936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.009023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.009168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.009262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.009401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.009480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.009657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.010240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.010438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.010531 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.010687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.010767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.010920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011715 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.011959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.012102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.012188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.012332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.012412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.012560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.012717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.012795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.012871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.013965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014434 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.014977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.015134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.015218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.015367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.015453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.015600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.015704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.015834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.015939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.016978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.017060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.017206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.017297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.017460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.017599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.017723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.017805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.017957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018046 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.018987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.019142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.019264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.019392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.019513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.019629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.019710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.019864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.019946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.020099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.020183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.020342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.020426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.020577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.020660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.020814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.020892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.021054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.021137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.021290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.021372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.021548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.021630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.021808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.021929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.022985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.023070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.023225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.023306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.023463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.023545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.023700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.023785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.023937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.024958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.025097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.025179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.025346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.025427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.026144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.026229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.026381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.026465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.026612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.026692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.026842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.026933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.027074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.027154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.027305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.027384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.027545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.027634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.027779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.027858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.028030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.028125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.028270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.028359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.028500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] auth.external = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.028579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.028730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.028821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.external = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029328 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] auth.password = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] auth.token = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.029948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.030104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.030187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.030340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.password = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.030422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.030575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] auth.token = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.030664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.030818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.030901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.031055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.031137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.031304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.031387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.031534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] credential.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.031617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.031780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.031862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.032973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.033057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.033218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.033300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.033458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.033567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.033722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.033811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.033957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.034037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.034203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.034284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.034460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.034543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.034700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.034783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.034958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.035045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.035215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.035304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.035449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] federation.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.035532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.035684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.035766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.035928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.036965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.037129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.037210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.037361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.037441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.037630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.037712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.037865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.037958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.038111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.038194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.038344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.038425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.038590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.038747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.038825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.038904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.039996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.040087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.040232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.040313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.040479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.040558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.040708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.040796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.040935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.041023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.041205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.041287 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.041450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.041565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.041707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.041787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.041942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.042024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.042177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.042271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.042430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.042512 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.042680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.042761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.042925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.043940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.044095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.044176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.044335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.044426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.044574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.044655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.045985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.046067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.046229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.046316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.046460 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.046554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.046693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.046776 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.046922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.047956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.048105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.048241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.048344 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.048495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.048577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.048746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.048836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.048978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.049164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.049246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.049422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.049530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.049699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.049783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.049934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.050961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.051113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.051193 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.051354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.051434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.051588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.051669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.051833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.051915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.052075 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.052155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.052310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.052394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.052541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.052623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.052777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.052859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053328 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.053983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.054062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.054223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.054304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.054456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.054539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.054698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.054779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.054929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.055956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.056105 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.056185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.056348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.056430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.056606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.056687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.056849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.056931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.057086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.057167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.057319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.057400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.057586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.057673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.057827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.057909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.058061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.058144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.058296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.058378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.058540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.058620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.058779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.058860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] resource.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.059964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.060993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.061159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.061239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.061392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.061472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.061675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.061758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.061910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] role.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.061990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.062158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] role.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.062239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.062389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.062471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.062630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.062710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.062867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] role.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.062949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.063112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.063194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] role.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.063341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.063427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.063591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.063679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.063836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.063982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.064123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.064204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.064330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.064421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.064561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.064644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.064806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.064888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.065051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.065136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.065297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.065379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.065554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.065676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.065810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.065984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.066070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.066220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.066304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.066469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.066552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.066718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.066944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.067028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.067184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.067266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.067419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.067509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.067678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.067758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.067925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.068943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.069108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.069191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.069341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.069423 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.069606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.069692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.069844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.069927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.070077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.070159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.070309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.070393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.070538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] token.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.070618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.070768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.070851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.071962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.072042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.072733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.072827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.072982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.073065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.073229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.073312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.073466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.073620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.073733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.073818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.073968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.074051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.074215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.074298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.074453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.074535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.074696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.074778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.074935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.connection = **** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075689 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.075991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.076152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.076244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.076394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.076495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.076626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.076709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.076861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.076953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.077097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.077179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.077332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.077414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.077612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.077712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.077844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.077930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.078080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.078161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.078317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.078407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.078562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.078643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.078794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.078876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.079908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 12:23:36.079983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.080205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.080448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.080686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 03 12:23:36.080859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 03 12:23:36.109861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.110088 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.110314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.111397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.111634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.111867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.118806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.124830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.148824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.149036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.149495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.149755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.203852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.204088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.253039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.253263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.254249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.254490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.409361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.409655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.409797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.409884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.409971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.410050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.410126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.410241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.410372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.410460 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.410542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.410666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.434050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.434273 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.434500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.434586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.434724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.434832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.434942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.435028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.435158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.435243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.435373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.435469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.435586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.435803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.446911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.447192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.461268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.461445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.461667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.461898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.462120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.462338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.462425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.462556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.462642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.462889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.463113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.463332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.463549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.463764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 03 12:23:36.479396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.479600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 12:23:36.479715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.479885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 12:23:36.479972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.480136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 12:23:36.480222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.480418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.480522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 03 12:23:36.480684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.480769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.480978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.481135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.481227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.481306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.481447 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.490854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.491053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.491141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.491337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.491424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.491614 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.491699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.491904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.499514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.499709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.502476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.502646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.502768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.502936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.503061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.503223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.503352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.503511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.503644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.503799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.503913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.504063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.504192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.504335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.504473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.504608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.504751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.504880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.505030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.505162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.505302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.505433 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.528827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.528980 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.530334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.530430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.530628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.530732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.535343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.535459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.535628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.535753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.535913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.536004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.542441 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.542645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.542767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.542903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.548788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.548995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.549090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.549306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.549404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.549627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.549716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.549925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.550032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.550212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.550305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.550486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.550571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.550759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.550845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.551033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.567056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.567340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.567515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.567717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.571168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.571587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.575065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.575372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.575505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.575773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.579554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.579975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.582647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.583114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.585852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.586152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.586338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.586427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.586645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.586733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.586937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.587026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.587226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.587322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.587515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.587825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.603005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.603294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.604080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.604169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.604345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.604431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.604692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.604966 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.611234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.611906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.612771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.613464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.614324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.614613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.615034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.615311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.617269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.617575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.617877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.618098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.618205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.618390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.618547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.618676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.618965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.619915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.630513 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.630805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.631091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.631375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.631460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.631715 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.631798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.632001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.632086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.632285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.632374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.632671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.632972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.633255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.647818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.648917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.650780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.651904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.653695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.654849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.655167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.656402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.656633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.656917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.657317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.657890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.658182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.658580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.663703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.664992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.665160 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.667008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.668598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.668993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.669283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.669586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.669942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.670353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.670644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.670931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.677402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.677715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.677998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.678805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.679105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.679389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.685392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.685700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.685996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.686272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.686550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.686827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.687017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 03 12:23:36.687170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.687317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.687462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.687616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.687762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.687913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.688066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.688256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.688441 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.688603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.688603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.688869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.688869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.689147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.689286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.689425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.689425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.689756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.689896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.690114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.690400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 03 12:23:36.723192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555b148049c0 pid: 81413 (default app) Oct 03 12:23:36.724688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555b148049c0 pid: 81412 (default app) Oct 03 12:23:36.726589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96999-e028-47fe-8b59-d9023337f6c3 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:36.726874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96999-e028-47fe-8b59-d9023337f6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:36.727154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee96999-e028-47fe-8b59-d9023337f6c3 None None] PATH_INFO: `/v3` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:36.731927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Mon Oct 3 12:23:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:43.651797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f41d-3869-4104-91fa-2af2fee54eab None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:43.652352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f41d-3869-4104-91fa-2af2fee54eab None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:43.652352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940f41d-3869-4104-91fa-2af2fee54eab None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:43.656592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:23:43.662230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:43.662824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:43.662824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:43.733438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: INFO dbcounter [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] Registered counter for database keystone Oct 03 12:23:43.753419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG oslo_db.sqlalchemy.engines [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:23:43.760329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writer thread running {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:23:43.942799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG passlib.handlers.bcrypt [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81413) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 03 12:23:43.943090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG passlib.handlers.bcrypt [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81413) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 03 12:23:44.002854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:44.004473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:44.135283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 03 12:23:44.571077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f41d-3869-4104-91fa-2af2fee54eab None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:44.640504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: INFO dbcounter [None req-2940f41d-3869-4104-91fa-2af2fee54eab None None] Registered counter for database keystone Oct 03 12:23:44.662506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG oslo_db.sqlalchemy.engines [None req-2940f41d-3869-4104-91fa-2af2fee54eab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 03 12:23:44.669670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writer thread running {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 03 12:23:44.790783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940f41d-3869-4104-91fa-2af2fee54eab None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:44.795180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595367-f409-4304-9dbe-ab2dc1d773c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:44.795814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595367-f409-4304-9dbe-ab2dc1d773c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:44.796099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595367-f409-4304-9dbe-ab2dc1d773c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:44.796374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595367-f409-4304-9dbe-ab2dc1d773c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:44.804974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595367-f409-4304-9dbe-ab2dc1d773c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:44.857421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING keystone.common.rbac_enforcer.enforcer [None req-38595367-f409-4304-9dbe-ab2dc1d773c7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 03 12:23:44.857720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595367-f409-4304-9dbe-ab2dc1d773c7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:44.868449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Mon Oct 3 12:23:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 12:23:44.874796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:44.892710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb592a-dfa4-4ea8-afb2-cac3dea8e930 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:44.897366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ae334-c8c5-47e2-b587-ba81f10cc1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:44.898530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ae334-c8c5-47e2-b587-ba81f10cc1df admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:44.898818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ae334-c8c5-47e2-b587-ba81f10cc1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:44.899105 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ae334-c8c5-47e2-b587-ba81f10cc1df admin admin] PATH_INFO: `/v3/projects/55a504954dfa4713bb307e2b5ecea75a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:44.901458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ae334-c8c5-47e2-b587-ba81f10cc1df admin admin] RBAC: Authorizing `identity:get_project(project_id=55a504954dfa4713bb307e2b5ecea75a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:44.954475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING keystone.common.rbac_enforcer.enforcer [None req-de0ae334-c8c5-47e2-b587-ba81f10cc1df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 03 12:23:44.954824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ae334-c8c5-47e2-b587-ba81f10cc1df admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:44.959484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Mon Oct 3 12:23:44 2022] GET /identity/v3/projects/55a504954dfa4713bb307e2b5ecea75a => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:23:47.133164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314f34-bf00-4856-9338-fc0657bcd70f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:47.133760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314f34-bf00-4856-9338-fc0657bcd70f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:47.133760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0314f34-bf00-4856-9338-fc0657bcd70f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:47.137865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:47.143539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844836-a0cc-4d1c-9335-d7330d526013 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:47.144041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844836-a0cc-4d1c-9335-d7330d526013 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:47.144148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee844836-a0cc-4d1c-9335-d7330d526013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:47.164447 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ee844836-a0cc-4d1c-9335-d7330d526013 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:47.166576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ee844836-a0cc-4d1c-9335-d7330d526013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:47.174639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 03 12:23:47.450067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0314f34-bf00-4856-9338-fc0657bcd70f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:47.462902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0314f34-bf00-4856-9338-fc0657bcd70f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:47.467263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5cc75-e2ab-43cb-bdac-c7a108facaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:47.467873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5cc75-e2ab-43cb-bdac-c7a108facaeb admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:47.468157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5cc75-e2ab-43cb-bdac-c7a108facaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:47.468604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5cc75-e2ab-43cb-bdac-c7a108facaeb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:47.483236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5cc75-e2ab-43cb-bdac-c7a108facaeb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:47.485066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5cc75-e2ab-43cb-bdac-c7a108facaeb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:47.494037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Mon Oct 3 12:23:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:23:47.500267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee844836-a0cc-4d1c-9335-d7330d526013 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:47.509339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee844836-a0cc-4d1c-9335-d7330d526013 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:47.513753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ac876-03c0-4259-a8b6-49b07165e9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:47.514379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ac876-03c0-4259-a8b6-49b07165e9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:47.514662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ac876-03c0-4259-a8b6-49b07165e9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:47.514992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ac876-03c0-4259-a8b6-49b07165e9f6 admin admin] PATH_INFO: `/v3/users/47b8fe7c355f40a8aebb0296c911e10a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:47.516248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ac876-03c0-4259-a8b6-49b07165e9f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=47b8fe7c355f40a8aebb0296c911e10a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:47.518109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ac876-03c0-4259-a8b6-49b07165e9f6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:47.519620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Mon Oct 3 12:23:47 2022] GET /identity/v3/users/47b8fe7c355f40a8aebb0296c911e10a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:49.745373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32894654-e53e-4570-a5b3-be66ba0f9bf7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:49.745969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32894654-e53e-4570-a5b3-be66ba0f9bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:49.745969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32894654-e53e-4570-a5b3-be66ba0f9bf7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:49.747516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:49.753180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f76b-bf78-4a30-96d1-1d69eb48f36b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:49.753665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f76b-bf78-4a30-96d1-1d69eb48f36b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:49.753764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10f76b-bf78-4a30-96d1-1d69eb48f36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:49.772117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2f10f76b-bf78-4a30-96d1-1d69eb48f36b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:49.773313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2f10f76b-bf78-4a30-96d1-1d69eb48f36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:49.834767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b196c-d5f8-4e62-adcb-3d9e3bbe7b32 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:49.835046 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b196c-d5f8-4e62-adcb-3d9e3bbe7b32 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:49.835320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b196c-d5f8-4e62-adcb-3d9e3bbe7b32 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:49.837153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:23:49.842789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:49.843080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:49.843355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:49.859412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:23:49.887532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG passlib.handlers.bcrypt [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81412) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 03 12:23:49.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG passlib.handlers.bcrypt [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81412) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 03 12:23:49.938616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:49.940302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:50.051230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:23:50.127158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10f76b-bf78-4a30-96d1-1d69eb48f36b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:50.154617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:50.260847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10f76b-bf78-4a30-96d1-1d69eb48f36b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:50.294910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426631d-4e59-49a5-a970-e671118cd9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:50.295579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426631d-4e59-49a5-a970-e671118cd9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:50.295862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426631d-4e59-49a5-a970-e671118cd9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:50.296140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426631d-4e59-49a5-a970-e671118cd9f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:50.307371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426631d-4e59-49a5-a970-e671118cd9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-b426631d-4e59-49a5-a970-e671118cd9f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:23:50.316171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:23:50.317240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:23:50.318154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:23:50.320337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:50.323607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426631d-4e59-49a5-a970-e671118cd9f0 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:50.420867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:50.435819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b10ae7-e08b-4d05-8180-6dfdc00daf44 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:50.439594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:50.444777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426631d-4e59-49a5-a970-e671118cd9f0 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:50.480236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bad34-0728-419b-9e87-2890ca6cb924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:50.481132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bad34-0728-419b-9e87-2890ca6cb924 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:50.481418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bad34-0728-419b-9e87-2890ca6cb924 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:50.481724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bad34-0728-419b-9e87-2890ca6cb924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:50.495182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:50.495798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:50.496082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:50.496357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:50.497301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:23:50.497640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:50.499065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:50.512870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:23:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:23:50.518469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:50.558299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bad34-0728-419b-9e87-2890ca6cb924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:50.559955 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bad34-0728-419b-9e87-2890ca6cb924 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:50.665352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 12:23:50.668779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7318df-d0e6-43df-92cb-4bd447864592 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:50.671466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bad34-0728-419b-9e87-2890ca6cb924 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:50.674543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:50.710606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a461f-2a49-4d38-b999-16bd2ea77294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:50.711349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a461f-2a49-4d38-b999-16bd2ea77294 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:50.712456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a461f-2a49-4d38-b999-16bd2ea77294 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:50.712456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a461f-2a49-4d38-b999-16bd2ea77294 None admin] PATH_INFO: `/v3/users/47b8fe7c355f40a8aebb0296c911e10a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:50.713407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a461f-2a49-4d38-b999-16bd2ea77294 None admin] RBAC: Authorizing `identity:get_user(user_id=47b8fe7c355f40a8aebb0296c911e10a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:50.714960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a461f-2a49-4d38-b999-16bd2ea77294 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:50.716731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:23:50 2022] GET /identity/v3/users/47b8fe7c355f40a8aebb0296c911e10a => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:23:50.722159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a461f-2a49-4d38-b999-16bd2ea77294 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:50.736998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:50.779647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bad34-0728-419b-9e87-2890ca6cb924 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:50.817192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:50.818009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:50.818292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:50.818569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:50.828047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a461f-2a49-4d38-b999-16bd2ea77294 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:50.838247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:50.839737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:23:50.859012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:23:50.860108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:23:50.861453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:23:50.861453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:23:50.861453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:23:50.861453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:23:50.864299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f227e-3184-4569-bc40-ab648eeac217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:50.864961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f227e-3184-4569-bc40-ab648eeac217 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:50.865230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f227e-3184-4569-bc40-ab648eeac217 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:50.865506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f227e-3184-4569-bc40-ab648eeac217 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:50.865953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:50.866670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f227e-3184-4569-bc40-ab648eeac217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:50.868754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f227e-3184-4569-bc40-ab648eeac217 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:50.870379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:23:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:23:50.877666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f227e-3184-4569-bc40-ab648eeac217 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:50.930970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:50.975575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:50.981198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3945-f47a-4e44-b80f-d1ce56ebd7dd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:51.015178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f227e-3184-4569-bc40-ab648eeac217 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:51.023510 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e86897-1845-40f1-838a-4755415494bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:51.024134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86897-1845-40f1-838a-4755415494bc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:51.024414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86897-1845-40f1-838a-4755415494bc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:51.024694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e86897-1845-40f1-838a-4755415494bc None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:51.025347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86897-1845-40f1-838a-4755415494bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:23:51.025680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86897-1845-40f1-838a-4755415494bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:51.027074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e86897-1845-40f1-838a-4755415494bc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:51.045494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:51.051533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85c3ff-789c-492f-ad95-8c39cc8936e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:51.052163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c3ff-789c-492f-ad95-8c39cc8936e9 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:51.052450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c3ff-789c-492f-ad95-8c39cc8936e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:51.052728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c3ff-789c-492f-ad95-8c39cc8936e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:51.053487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c3ff-789c-492f-ad95-8c39cc8936e9 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.domain.id=default, user.id=47b8fe7c355f40a8aebb0296c911e10a) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:23:51.053834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c3ff-789c-492f-ad95-8c39cc8936e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:51.055940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c3ff-789c-492f-ad95-8c39cc8936e9 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:51.063695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 11/21] 10.222.0.17 () {56 vars in 1322 bytes} [Mon Oct 3 12:23:50 2022] GET /identity/v3/role_assignments?user.id=47b8fe7c355f40a8aebb0296c911e10a&scope.domain.id=default&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 233 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:23:53.727210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e31d12-3471-469c-a737-6404ac54d75e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:53.727717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e31d12-3471-469c-a737-6404ac54d75e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:53.727818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e31d12-3471-469c-a737-6404ac54d75e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:53.729406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:53.734932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafafb6-9633-4afa-b6e9-caf062f365cd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:53.735405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafafb6-9633-4afa-b6e9-caf062f365cd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:53.735586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafafb6-9633-4afa-b6e9-caf062f365cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:53.761367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-adafafb6-9633-4afa-b6e9-caf062f365cd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:53.762613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-adafafb6-9633-4afa-b6e9-caf062f365cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:53.800037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2373721-b3df-4fd3-9dc2-432c0921e138 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:53.800366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2373721-b3df-4fd3-9dc2-432c0921e138 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:53.800598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2373721-b3df-4fd3-9dc2-432c0921e138 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:53.802143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 12/23] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:53.807948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a99dc-dc80-4976-ae03-1b92d4aeac76 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:53.808235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a99dc-dc80-4976-ae03-1b92d4aeac76 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:53.808511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a99dc-dc80-4976-ae03-1b92d4aeac76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:53.833943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-674a99dc-dc80-4976-ae03-1b92d4aeac76 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:53.835159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-674a99dc-dc80-4976-ae03-1b92d4aeac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:53.902502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 12/24] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:23:53.958941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:23:54.187772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402a14-1557-4a94-907f-79cf2453e1f1 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:54.188130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402a14-1557-4a94-907f-79cf2453e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:54.188331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402a14-1557-4a94-907f-79cf2453e1f1 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:54.189731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 13/26] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:54.195218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d90121-e90a-4a59-a1dc-6b5c9d2d1bd0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:54.195561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d90121-e90a-4a59-a1dc-6b5c9d2d1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:54.195840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d90121-e90a-4a59-a1dc-6b5c9d2d1bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:54.218599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d4d90121-e90a-4a59-a1dc-6b5c9d2d1bd0 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:54.219716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d4d90121-e90a-4a59-a1dc-6b5c9d2d1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:54.273187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:54.301391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3402a14-1557-4a94-907f-79cf2453e1f1 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:54.313104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:23:54.330980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d90121-e90a-4a59-a1dc-6b5c9d2d1bd0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:54.459590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:54.499764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3402a14-1557-4a94-907f-79cf2453e1f1 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:54.532415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d90121-e90a-4a59-a1dc-6b5c9d2d1bd0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:54.561948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cc77a-10a7-4e88-a1aa-c82703eaa323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:54.562862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cc77a-10a7-4e88-a1aa-c82703eaa323 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:54.563142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cc77a-10a7-4e88-a1aa-c82703eaa323 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:54.563415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cc77a-10a7-4e88-a1aa-c82703eaa323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:54.583788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cc77a-10a7-4e88-a1aa-c82703eaa323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-8f9cc77a-10a7-4e88-a1aa-c82703eaa323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:23:54.590133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:23:54.591228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:23:54.592198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:23:54.594407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 14/28] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:23:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:23:54.596277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9cdf-bdaf-42dd-83f9-289c766ee84c None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:54.596708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9cdf-bdaf-42dd-83f9-289c766ee84c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:54.597179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9cdf-bdaf-42dd-83f9-289c766ee84c None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:54.599846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 15/29] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:54.600893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f9cdf-bdaf-42dd-83f9-289c766ee84c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:54.604898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9c654-5309-4cf7-86d0-8da20ddec23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:54.610558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c654-5309-4cf7-86d0-8da20ddec23c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:54.610558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c654-5309-4cf7-86d0-8da20ddec23c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:54.610558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9c654-5309-4cf7-86d0-8da20ddec23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:54.646433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9c654-5309-4cf7-86d0-8da20ddec23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:54.647952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9c654-5309-4cf7-86d0-8da20ddec23c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-bbc9c654-5309-4cf7-86d0-8da20ddec23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:23:54.676571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:23:54.678645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:23:54.680651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:23:54.680651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:23:54.680651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:23:54.680651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 15/30] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:23:54.680651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117894-8060-4ce6-9bb0-54e104456a8e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:54.680651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117894-8060-4ce6-9bb0-54e104456a8e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:54.680651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117894-8060-4ce6-9bb0-54e104456a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:54.712298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-24117894-8060-4ce6-9bb0-54e104456a8e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:54.714822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-24117894-8060-4ce6-9bb0-54e104456a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:54.762923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:54.803149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f9cdf-bdaf-42dd-83f9-289c766ee84c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:54.816163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 16/31] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:23:54.817399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117894-8060-4ce6-9bb0-54e104456a8e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:54.845836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:54.846444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:54.846731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:54.847067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:54.847748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:23:54.848057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:54.849775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:54.851387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:54.861305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 16/32] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:23:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:54.862201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:54.928796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117894-8060-4ce6-9bb0-54e104456a8e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:54.968144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:54.969132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:54.969664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:54.970135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:54.971003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:23:54.971507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:54.973120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:54.978925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480a45-28fe-4360-a2c5-e69648f9c3cd None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:54.985937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 17/33] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:54.987246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:55.009566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:55.022382 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8d268-f396-489b-915a-2e6a79590655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:55.022920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d268-f396-489b-915a-2e6a79590655 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:55.023218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d268-f396-489b-915a-2e6a79590655 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:55.023540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8d268-f396-489b-915a-2e6a79590655 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:55.024231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d268-f396-489b-915a-2e6a79590655 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:55.025815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8d268-f396-489b-915a-2e6a79590655 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:55.119320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ff923-3577-48a7-8efd-afd76797faa4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:55.184216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e07223-2e1f-4e8c-aa12-b78cae2a8dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:55.185251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e07223-2e1f-4e8c-aa12-b78cae2a8dcf None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:55.185780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e07223-2e1f-4e8c-aa12-b78cae2a8dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:55.186283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e07223-2e1f-4e8c-aa12-b78cae2a8dcf None admin] PATH_INFO: `/v3/users/47b8fe7c355f40a8aebb0296c911e10a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:55.188016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e07223-2e1f-4e8c-aa12-b78cae2a8dcf None admin] RBAC: Authorizing `identity:get_user(user_id=47b8fe7c355f40a8aebb0296c911e10a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:55.189869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e07223-2e1f-4e8c-aa12-b78cae2a8dcf None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:55.191907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 18/34] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:23:54 2022] GET /identity/v3/users/47b8fe7c355f40a8aebb0296c911e10a => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:55.193038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e07223-2e1f-4e8c-aa12-b78cae2a8dcf None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:55.244046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 17/35] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Oct 3 12:23:54 2022] POST /identity/v3/roles => generated 225 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:23:55.250296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8d268-f396-489b-915a-2e6a79590655 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:55.297577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:55.316940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e07223-2e1f-4e8c-aa12-b78cae2a8dcf None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:55.346166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:55.359048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60af812-35e5-401f-88ec-c2a8af68a570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:55.360113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af812-35e5-401f-88ec-c2a8af68a570 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:55.360596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af812-35e5-401f-88ec-c2a8af68a570 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:55.361063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60af812-35e5-401f-88ec-c2a8af68a570 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:55.362003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60af812-35e5-401f-88ec-c2a8af68a570 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:55.363746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60af812-35e5-401f-88ec-c2a8af68a570 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:55.403404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8d268-f396-489b-915a-2e6a79590655 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:55.445675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7bbdaf-e92a-47f9-9cc9-f6caebc056db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:55.446347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bbdaf-e92a-47f9-9cc9-f6caebc056db None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:55.446633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bbdaf-e92a-47f9-9cc9-f6caebc056db None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:55.446912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7bbdaf-e92a-47f9-9cc9-f6caebc056db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:55.448245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bbdaf-e92a-47f9-9cc9-f6caebc056db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:55.449967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7bbdaf-e92a-47f9-9cc9-f6caebc056db None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:55.456576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 18/36] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:23:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:55.458136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733a9ee-9274-4911-a972-5be2ab3ffa9a None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:55.458428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733a9ee-9274-4911-a972-5be2ab3ffa9a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:55.458748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733a9ee-9274-4911-a972-5be2ab3ffa9a None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:55.460389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 19/37] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:55.461176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733a9ee-9274-4911-a972-5be2ab3ffa9a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:55.526969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 19/38] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:23:55 2022] POST /identity/v3/projects => generated 301 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:23:55.527954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60af812-35e5-401f-88ec-c2a8af68a570 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:55.601200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733a9ee-9274-4911-a972-5be2ab3ffa9a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:55.659417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60af812-35e5-401f-88ec-c2a8af68a570 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:55.710159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75409acb-b557-4044-953d-110904598095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:55.711849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409acb-b557-4044-953d-110904598095 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:55.712351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409acb-b557-4044-953d-110904598095 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:55.712848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409acb-b557-4044-953d-110904598095 None admin] PATH_INFO: `/v3/domains/default/users/47b8fe7c355f40a8aebb0296c911e10a/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:55.715713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75409acb-b557-4044-953d-110904598095 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=47b8fe7c355f40a8aebb0296c911e10a, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:55.717988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75409acb-b557-4044-953d-110904598095 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:55.737179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:55.743996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 20/39] 10.222.0.17 () {58 vars in 1361 bytes} [Mon Oct 3 12:23:55 2022] PUT /identity/v3/domains/default/users/47b8fe7c355f40a8aebb0296c911e10a/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:23:55.745908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab59a7-1ac5-4c88-8c19-e245916c2de1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:55.746480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab59a7-1ac5-4c88-8c19-e245916c2de1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:55.747353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab59a7-1ac5-4c88-8c19-e245916c2de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:55.766220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:55.773752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e5ab59a7-1ac5-4c88-8c19-e245916c2de1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:55.777195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e5ab59a7-1ac5-4c88-8c19-e245916c2de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:55.781721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8b17-87f5-4291-8a00-3d557f7a94e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:55.781926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8b17-87f5-4291-8a00-3d557f7a94e2 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:55.782191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8b17-87f5-4291-8a00-3d557f7a94e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:55.782521 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8b17-87f5-4291-8a00-3d557f7a94e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:55.783346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8b17-87f5-4291-8a00-3d557f7a94e2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:55.784926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a8b17-87f5-4291-8a00-3d557f7a94e2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:55.806178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Oct 3 12:23:55 2022] POST /identity/v3/roles => generated 219 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:23:55.870553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 21/41] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:23:56.154938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8b17-87f5-4291-8a00-3d557f7a94e2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:56.261188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8b17-87f5-4291-8a00-3d557f7a94e2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:56.296770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb0b63-8ddc-45d8-8786-122167df11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:56.297434 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0b63-8ddc-45d8-8786-122167df11a9 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:56.297746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0b63-8ddc-45d8-8786-122167df11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:56.298023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb0b63-8ddc-45d8-8786-122167df11a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:56.298711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb0b63-8ddc-45d8-8786-122167df11a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:56.300101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb0b63-8ddc-45d8-8786-122167df11a9 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:56.309992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b433c5c-c29a-40df-b492-ed620734f21e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:56.310891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b433c5c-c29a-40df-b492-ed620734f21e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:56.311812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b433c5c-c29a-40df-b492-ed620734f21e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:56.313808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 22/42] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:23:56.317571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 21/43] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Oct 3 12:23:56 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:23:56.322036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798a3a3-4a39-43af-b595-f4cadf992764 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:56.322491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798a3a3-4a39-43af-b595-f4cadf992764 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:56.322678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798a3a3-4a39-43af-b595-f4cadf992764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:56.342603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3798a3a3-4a39-43af-b595-f4cadf992764 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:56.343853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3798a3a3-4a39-43af-b595-f4cadf992764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:56.457664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 23/44] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:23:56.725996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb0b63-8ddc-45d8-8786-122167df11a9 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:56.779232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:56.845580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb0b63-8ddc-45d8-8786-122167df11a9 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:56.904592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9dd69-c8a6-4b75-9230-4477a927bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:56.905735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9dd69-c8a6-4b75-9230-4477a927bda2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:56.906250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9dd69-c8a6-4b75-9230-4477a927bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:56.906571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9dd69-c8a6-4b75-9230-4477a927bda2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:56.908549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9dd69-c8a6-4b75-9230-4477a927bda2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:56.911152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9dd69-c8a6-4b75-9230-4477a927bda2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:56.914362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 22/45] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:23:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:56.919871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798a3a3-4a39-43af-b595-f4cadf992764 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:56.980604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:57.024391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798a3a3-4a39-43af-b595-f4cadf992764 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:57.058460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276d15-409b-4b90-a621-891857bb4d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:57.059087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276d15-409b-4b90-a621-891857bb4d2d None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:57.059375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276d15-409b-4b90-a621-891857bb4d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:57.059655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276d15-409b-4b90-a621-891857bb4d2d None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:57.060333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa276d15-409b-4b90-a621-891857bb4d2d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:57.061822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa276d15-409b-4b90-a621-891857bb4d2d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:57.089408 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:23:56 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:23:58.034303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae489e3-cd68-4234-8be4-f393943e8f3e None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:58.034792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae489e3-cd68-4234-8be4-f393943e8f3e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:58.034792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae489e3-cd68-4234-8be4-f393943e8f3e None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:58.036128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 23/47] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:58.042834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdcba6-e9bc-40c2-8255-e085f45138dc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:58.042834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdcba6-e9bc-40c2-8255-e085f45138dc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:58.042834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdcba6-e9bc-40c2-8255-e085f45138dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:58.060852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-08fdcba6-e9bc-40c2-8255-e085f45138dc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:58.062074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-08fdcba6-e9bc-40c2-8255-e085f45138dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:58.128423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 25/48] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:23:58.397297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae489e3-cd68-4234-8be4-f393943e8f3e None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:58.498963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae489e3-cd68-4234-8be4-f393943e8f3e None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:58.513910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:58.535425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4509053-c33f-41d7-916f-49da039c16ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:58.536059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509053-c33f-41d7-916f-49da039c16ba None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:58.536341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509053-c33f-41d7-916f-49da039c16ba None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:58.536619 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509053-c33f-41d7-916f-49da039c16ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:58.546599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4509053-c33f-41d7-916f-49da039c16ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-a4509053-c33f-41d7-916f-49da039c16ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:23:58.551438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:23:58.552558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:23:58.553494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 24/49] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:23:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:23:58.558372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdcba6-e9bc-40c2-8255-e085f45138dc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:58.598608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:58.660253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdcba6-e9bc-40c2-8255-e085f45138dc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:58.697012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:58.697712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:58.700378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:58.700378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:58.700378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:23:58.700378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:58.700676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:58.714165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 26/50] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:23:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:58.719800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4509053-c33f-41d7-916f-49da039c16ba None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:58.819456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4509053-c33f-41d7-916f-49da039c16ba None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:58.854448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8228e3-c3f6-4738-9712-89cf93719ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:58.855079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8228e3-c3f6-4738-9712-89cf93719ead None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:58.855361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8228e3-c3f6-4738-9712-89cf93719ead None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:58.855635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8228e3-c3f6-4738-9712-89cf93719ead None admin] PATH_INFO: `/v3/users/47b8fe7c355f40a8aebb0296c911e10a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:58.856758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8228e3-c3f6-4738-9712-89cf93719ead None admin] RBAC: Authorizing `identity:get_user(user_id=47b8fe7c355f40a8aebb0296c911e10a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:58.858259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8228e3-c3f6-4738-9712-89cf93719ead None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:58.859829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 25/51] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:23:58 2022] GET /identity/v3/users/47b8fe7c355f40a8aebb0296c911e10a => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:58.865244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:58.967686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88489-88a0-4809-9377-7fafcb9391e8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:58.969151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:59.003037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630496-8008-4ff3-b955-99a531fb5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:59.003684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630496-8008-4ff3-b955-99a531fb5fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:59.003959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630496-8008-4ff3-b955-99a531fb5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:59.004232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630496-8008-4ff3-b955-99a531fb5fc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:59.005344 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630496-8008-4ff3-b955-99a531fb5fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:59.006816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630496-8008-4ff3-b955-99a531fb5fc8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:59.008923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 27/52] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:23:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:59.014844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8228e3-c3f6-4738-9712-89cf93719ead None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:59.056460 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:23:59.114995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8228e3-c3f6-4738-9712-89cf93719ead None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:59.148800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba5617-ed18-49b3-aae7-46ebaaa13a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:59.149401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5617-ed18-49b3-aae7-46ebaaa13a33 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:59.149714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5617-ed18-49b3-aae7-46ebaaa13a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:59.149994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba5617-ed18-49b3-aae7-46ebaaa13a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:59.150902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba5617-ed18-49b3-aae7-46ebaaa13a33 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.domain.id=default, user.id=47b8fe7c355f40a8aebb0296c911e10a) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:23:59.151048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba5617-ed18-49b3-aae7-46ebaaa13a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:59.152547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba5617-ed18-49b3-aae7-46ebaaa13a33 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:59.159435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1322 bytes} [Mon Oct 3 12:23:59 2022] GET /identity/v3/role_assignments?user.id=47b8fe7c355f40a8aebb0296c911e10a&scope.domain.id=default&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:59.287514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768681-8ec7-45ef-ab01-4ad36b438294 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:59.288040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768681-8ec7-45ef-ab01-4ad36b438294 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:59.288040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768681-8ec7-45ef-ab01-4ad36b438294 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:59.289633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 28/54] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:23:59.295641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355153a-e153-4912-93b6-5762ab12ab0a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:59.295931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355153a-e153-4912-93b6-5762ab12ab0a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:59.296206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355153a-e153-4912-93b6-5762ab12ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:59.316474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8355153a-e153-4912-93b6-5762ab12ab0a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:23:59.318083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8355153a-e153-4912-93b6-5762ab12ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:23:59.390204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 27/55] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:23:59.657617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3768681-8ec7-45ef-ab01-4ad36b438294 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:59.865298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3768681-8ec7-45ef-ab01-4ad36b438294 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:23:59.899198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a6cc0-cb94-489c-a63a-dedea04f3afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:23:59.899832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a6cc0-cb94-489c-a63a-dedea04f3afd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:23:59.900114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a6cc0-cb94-489c-a63a-dedea04f3afd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:23:59.900390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a6cc0-cb94-489c-a63a-dedea04f3afd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:23:59.901603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a6cc0-cb94-489c-a63a-dedea04f3afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:23:59.902978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a6cc0-cb94-489c-a63a-dedea04f3afd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:23:59.904544 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 29/56] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:23:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:23:59.910262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355153a-e153-4912-93b6-5762ab12ab0a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:23:59.943900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:00.010167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355153a-e153-4912-93b6-5762ab12ab0a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:00.043370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4029a-c825-4f16-9512-07ca74e589d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:00.043984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4029a-c825-4f16-9512-07ca74e589d4 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:00.044270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4029a-c825-4f16-9512-07ca74e589d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:00.044550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4029a-c825-4f16-9512-07ca74e589d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:00.045215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4029a-c825-4f16-9512-07ca74e589d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:00.046722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4029a-c825-4f16-9512-07ca74e589d4 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:00.074642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 28/57] 10.222.0.17 () {60 vars in 1140 bytes} [Mon Oct 3 12:23:59 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:02.266844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c534c1-c2a6-46e9-b1fa-f7fd33c6c680 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:02.267374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c534c1-c2a6-46e9-b1fa-f7fd33c6c680 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:02.267483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c534c1-c2a6-46e9-b1fa-f7fd33c6c680 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:02.268746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 30/58] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:02.274791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940ce6e-4f0a-4984-aeb3-c584f0d08fc6 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:02.275193 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940ce6e-4f0a-4984-aeb3-c584f0d08fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:02.275351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940ce6e-4f0a-4984-aeb3-c584f0d08fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:02.293418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8940ce6e-4f0a-4984-aeb3-c584f0d08fc6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:02.294655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8940ce6e-4f0a-4984-aeb3-c584f0d08fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:02.360786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:02.628038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c534c1-c2a6-46e9-b1fa-f7fd33c6c680 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:02.668813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:02.728877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c534c1-c2a6-46e9-b1fa-f7fd33c6c680 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:02.766674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf9341-bca6-4645-bfdb-31be00059293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:02.767220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9341-bca6-4645-bfdb-31be00059293 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:02.767505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9341-bca6-4645-bfdb-31be00059293 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:02.767848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9341-bca6-4645-bfdb-31be00059293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:02.768901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf9341-bca6-4645-bfdb-31be00059293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:02.770385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf9341-bca6-4645-bfdb-31be00059293 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:02.771967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 31/60] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:02.777714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940ce6e-4f0a-4984-aeb3-c584f0d08fc6 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:02.794817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:02.885556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940ce6e-4f0a-4984-aeb3-c584f0d08fc6 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:02.920367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525facc-df70-4f44-adce-a8fa250a41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:02.920983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525facc-df70-4f44-adce-a8fa250a41d0 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:02.921271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525facc-df70-4f44-adce-a8fa250a41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:02.921577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525facc-df70-4f44-adce-a8fa250a41d0 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:02.922240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525facc-df70-4f44-adce-a8fa250a41d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:02.923698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525facc-df70-4f44-adce-a8fa250a41d0 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:02.954689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 30/61] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:24:02 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:06.691875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba897e26-06ea-4371-ba93-c263966a35bd None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:06.692404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba897e26-06ea-4371-ba93-c263966a35bd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:06.693128 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba897e26-06ea-4371-ba93-c263966a35bd None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:06.697813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 32/62] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:06.706523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c6b6-18a0-4f3a-b23e-bb4c4c657399 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:06.707402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c6b6-18a0-4f3a-b23e-bb4c4c657399 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:06.707825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340c6b6-18a0-4f3a-b23e-bb4c4c657399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:06.754606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6340c6b6-18a0-4f3a-b23e-bb4c4c657399 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:06.758779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6340c6b6-18a0-4f3a-b23e-bb4c4c657399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:06.850204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50fa5-46e1-4c19-a7b3-fa04a7373300 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:06.850887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50fa5-46e1-4c19-a7b3-fa04a7373300 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:06.851367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c50fa5-46e1-4c19-a7b3-fa04a7373300 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:06.852899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 33/63] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:06.857990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daa492-1a88-4c7a-9c4d-9d74f9fb9459 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:06.858513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daa492-1a88-4c7a-9c4d-9d74f9fb9459 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:06.859009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daa492-1a88-4c7a-9c4d-9d74f9fb9459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:06.907124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-57daa492-1a88-4c7a-9c4d-9d74f9fb9459 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:06.909242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-57daa492-1a88-4c7a-9c4d-9d74f9fb9459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:06.924130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 31/64] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:07.027855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 34/65] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:07.192743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433dfe6-a3c4-4873-9c27-4193742d54e8 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.193154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433dfe6-a3c4-4873-9c27-4193742d54e8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.193379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433dfe6-a3c4-4873-9c27-4193742d54e8 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.195575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 32/66] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:07.195767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7ff3-69af-48b6-a6f8-516042c03bfc None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.196698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7ff3-69af-48b6-a6f8-516042c03bfc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.196698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c7ff3-69af-48b6-a6f8-516042c03bfc None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.197624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 35/67] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:07.204868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736ceb-20a3-4d08-82be-b07cecdb00f4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.205541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736ceb-20a3-4d08-82be-b07cecdb00f4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.207062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14abed-c2ff-4bc1-b4e2-51672541ad40 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.207343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14abed-c2ff-4bc1-b4e2-51672541ad40 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.207619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14abed-c2ff-4bc1-b4e2-51672541ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.210032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736ceb-20a3-4d08-82be-b07cecdb00f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.218866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:07.234403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ca14abed-c2ff-4bc1-b4e2-51672541ad40 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:07.235587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ca14abed-c2ff-4bc1-b4e2-51672541ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:07.248655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-dc736ceb-20a3-4d08-82be-b07cecdb00f4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:07.249970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-dc736ceb-20a3-4d08-82be-b07cecdb00f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:07.282637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:07.327416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 36/68] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:07.328931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d277f47-2cf7-4239-ae31-a62eab72b621 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.329217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d277f47-2cf7-4239-ae31-a62eab72b621 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.329498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d277f47-2cf7-4239-ae31-a62eab72b621 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.330762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 37/69] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:07.331464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d277f47-2cf7-4239-ae31-a62eab72b621 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:07.354878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 33/70] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:07.356477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0261f1-3b6a-49f0-8715-078f21193c50 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.356971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0261f1-3b6a-49f0-8715-078f21193c50 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.357467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0261f1-3b6a-49f0-8715-078f21193c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.380962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-dc0261f1-3b6a-49f0-8715-078f21193c50 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:07.382233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-dc0261f1-3b6a-49f0-8715-078f21193c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:07.443450 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d277f47-2cf7-4239-ae31-a62eab72b621 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:07.455413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 34/71] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:07.456635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0261f1-3b6a-49f0-8715-078f21193c50 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:07.502301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf1a1d-720d-49fd-bf8f-f5db05113f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:07.502963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf1a1d-720d-49fd-bf8f-f5db05113f0c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.503253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf1a1d-720d-49fd-bf8f-f5db05113f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.503524 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf1a1d-720d-49fd-bf8f-f5db05113f0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.517308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf1a1d-720d-49fd-bf8f-f5db05113f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1dcf1a1d-720d-49fd-bf8f-f5db05113f0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:07.524517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:07.525435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:07.526232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:07.528082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:07.529036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 38/72] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:07.536080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf1a1d-720d-49fd-bf8f-f5db05113f0c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:07.573998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0261f1-3b6a-49f0-8715-078f21193c50 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:07.582394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:07.611964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907017b6-6a42-42f8-b824-27e1c7791ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:07.612648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907017b6-6a42-42f8-b824-27e1c7791ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.612935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907017b6-6a42-42f8-b824-27e1c7791ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.613219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907017b6-6a42-42f8-b824-27e1c7791ce2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.629299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907017b6-6a42-42f8-b824-27e1c7791ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-907017b6-6a42-42f8-b824-27e1c7791ce2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:07.635729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:07.636644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:07.637389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 35/73] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:07.643986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907017b6-6a42-42f8-b824-27e1c7791ce2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:07.697731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf1a1d-720d-49fd-bf8f-f5db05113f0c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:07.738245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:07.738879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.739173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.739452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.740140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:07.740452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:07.742420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:07.753605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 39/74] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:07.754718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:07.776181 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907017b6-6a42-42f8-b824-27e1c7791ce2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:07.801152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:07.815316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:07.815935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.816212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.816483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.817162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:07.817461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:07.818996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:07.827828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 36/75] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:07.828659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:07.856391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:07.870256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b0a41-6ee5-4890-9bd5-3ea5132f673d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:07.906579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37b4df-e901-4574-bd2a-3063023972e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:07.907231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b4df-e901-4574-bd2a-3063023972e3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.907519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b4df-e901-4574-bd2a-3063023972e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.907800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37b4df-e901-4574-bd2a-3063023972e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.918609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37b4df-e901-4574-bd2a-3063023972e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1a37b4df-e901-4574-bd2a-3063023972e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:07.923988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:07.925147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:07.926171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:07.929667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 40/76] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:07.930717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37b4df-e901-4574-bd2a-3063023972e3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:07.938174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cce553-e787-420f-9834-293aa7cb5d30 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:07.972357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77f82c-4a08-4f73-be0f-d866bdd7efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:07.973023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77f82c-4a08-4f73-be0f-d866bdd7efc5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:07.973311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77f82c-4a08-4f73-be0f-d866bdd7efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:07.973627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77f82c-4a08-4f73-be0f-d866bdd7efc5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:07.974830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77f82c-4a08-4f73-be0f-d866bdd7efc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:07.976870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77f82c-4a08-4f73-be0f-d866bdd7efc5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:07.978646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 37/77] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:07.979341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77f82c-4a08-4f73-be0f-d866bdd7efc5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.032798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:08.032991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37b4df-e901-4574-bd2a-3063023972e3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.068369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e96b15-da09-4a3c-8cd5-4ebb4ad38f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.068944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e96b15-da09-4a3c-8cd5-4ebb4ad38f69 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.069229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e96b15-da09-4a3c-8cd5-4ebb4ad38f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.069509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e96b15-da09-4a3c-8cd5-4ebb4ad38f69 None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.082186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77f82c-4a08-4f73-be0f-d866bdd7efc5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.085112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e96b15-da09-4a3c-8cd5-4ebb4ad38f69 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:08.086635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e96b15-da09-4a3c-8cd5-4ebb4ad38f69 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:08.088281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 41/78] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:07 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:08.089058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e96b15-da09-4a3c-8cd5-4ebb4ad38f69 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.101277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:08.118403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77b129-fa87-4751-a65e-797d0f76b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.119269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b129-fa87-4751-a65e-797d0f76b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.119369 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b129-fa87-4751-a65e-797d0f76b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.119590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77b129-fa87-4751-a65e-797d0f76b6f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.130934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77b129-fa87-4751-a65e-797d0f76b6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-7f77b129-fa87-4751-a65e-797d0f76b6f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:08.136828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:08.137720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 38/79] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:24:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:08.139923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77b129-fa87-4751-a65e-797d0f76b6f8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.200449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e96b15-da09-4a3c-8cd5-4ebb4ad38f69 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.235496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6f56-60f0-4a51-8ce4-b981111a162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.236145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6f56-60f0-4a51-8ce4-b981111a162d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.236437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6f56-60f0-4a51-8ce4-b981111a162d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.236721 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6f56-60f0-4a51-8ce4-b981111a162d None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.237920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6f56-60f0-4a51-8ce4-b981111a162d None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:08.239401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6f56-60f0-4a51-8ce4-b981111a162d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:08.241054 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 42/80] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:08 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:08.241845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6f56-60f0-4a51-8ce4-b981111a162d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.252329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77b129-fa87-4751-a65e-797d0f76b6f8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.266909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:08.289533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.290166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.290453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.290735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.291405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:08.291713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:08.293129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:08.302196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 39/81] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:08.303062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.326143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:08.356106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6f56-60f0-4a51-8ce4-b981111a162d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.390697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6055-ef46-4690-8de3-7bd8092fbec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.391321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6055-ef46-4690-8de3-7bd8092fbec2 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.391603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6055-ef46-4690-8de3-7bd8092fbec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.391902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d6055-ef46-4690-8de3-7bd8092fbec2 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.392550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d6055-ef46-4690-8de3-7bd8092fbec2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:08.394024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d6055-ef46-4690-8de3-7bd8092fbec2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:08.406406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3b8de-7133-4e59-8f6a-98e9c12b9e35 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.422828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 43/82] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:24:08 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:08.423906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6055-ef46-4690-8de3-7bd8092fbec2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.466707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa2e5c-625e-4b81-9b5c-b65ee9c57f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.467338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2e5c-625e-4b81-9b5c-b65ee9c57f3b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.467622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2e5c-625e-4b81-9b5c-b65ee9c57f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.467903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa2e5c-625e-4b81-9b5c-b65ee9c57f3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.533656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:08.556889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d6055-ef46-4690-8de3-7bd8092fbec2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.566036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa2e5c-625e-4b81-9b5c-b65ee9c57f3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:08.567153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa2e5c-625e-4b81-9b5c-b65ee9c57f3b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:08.610549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:08.619647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.620979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.620979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.622435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.623438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:08.623763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:08.625165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:08.636431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 44/83] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:08.642136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.720790 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 40/84] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:08.722492 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa2e5c-625e-4b81-9b5c-b65ee9c57f3b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.787075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f9933-e843-436d-b195-6030593958cf None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.829134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:08.835775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e0488-a852-419b-bc2b-ea2d9df53f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.836430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e0488-a852-419b-bc2b-ea2d9df53f20 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.836719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e0488-a852-419b-bc2b-ea2d9df53f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.837002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e0488-a852-419b-bc2b-ea2d9df53f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.864887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa2e5c-625e-4b81-9b5c-b65ee9c57f3b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:08.907771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078481-1058-458e-ae85-efd0a62f79ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:08.908969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078481-1058-458e-ae85-efd0a62f79ed None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:08.909394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078481-1058-458e-ae85-efd0a62f79ed None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:08.909997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078481-1058-458e-ae85-efd0a62f79ed None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:08.911663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a078481-1058-458e-ae85-efd0a62f79ed None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:08.914144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a078481-1058-458e-ae85-efd0a62f79ed None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:08.915534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 41/85] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:08 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:08.916202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078481-1058-458e-ae85-efd0a62f79ed None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:08.930874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:08.946938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e0488-a852-419b-bc2b-ea2d9df53f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:08.949180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e0488-a852-419b-bc2b-ea2d9df53f20 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:09.058809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078481-1058-458e-ae85-efd0a62f79ed None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:09.069948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 45/86] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:09.070952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e0488-a852-419b-bc2b-ea2d9df53f20 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:09.107735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d2e8e-f689-4c07-8e24-cee85bf1aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:09.109554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2e8e-f689-4c07-8e24-cee85bf1aaea None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:09.110041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2e8e-f689-4c07-8e24-cee85bf1aaea None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:09.110489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2e8e-f689-4c07-8e24-cee85bf1aaea None admin] PATH_INFO: `/v3/users/47b8fe7c355f40a8aebb0296c911e10a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:09.111813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d2e8e-f689-4c07-8e24-cee85bf1aaea None admin] RBAC: Authorizing `identity:get_user(user_id=47b8fe7c355f40a8aebb0296c911e10a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:09.113437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d2e8e-f689-4c07-8e24-cee85bf1aaea None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:09.117149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 42/87] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:08 2022] GET /identity/v3/users/47b8fe7c355f40a8aebb0296c911e10a => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:09.118227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d2e8e-f689-4c07-8e24-cee85bf1aaea None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:09.134540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:09.180623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:09.190786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e0488-a852-419b-bc2b-ea2d9df53f20 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:09.230903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acea22-b969-44d6-9690-09de206c473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:09.231675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acea22-b969-44d6-9690-09de206c473b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:09.232006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acea22-b969-44d6-9690-09de206c473b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:09.232351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acea22-b969-44d6-9690-09de206c473b None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:09.233698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acea22-b969-44d6-9690-09de206c473b None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:09.235245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acea22-b969-44d6-9690-09de206c473b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:09.237120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 46/88] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:09 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:09.242674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acea22-b969-44d6-9690-09de206c473b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:09.258271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d2e8e-f689-4c07-8e24-cee85bf1aaea None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:09.304836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd289fe-d8d3-4e56-9769-87f3f6dbbcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:09.305771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd289fe-d8d3-4e56-9769-87f3f6dbbcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:09.306437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd289fe-d8d3-4e56-9769-87f3f6dbbcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:09.306952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd289fe-d8d3-4e56-9769-87f3f6dbbcf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:09.359734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acea22-b969-44d6-9690-09de206c473b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:09.399219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bde17-4b97-4f8b-845f-0b9dd52274b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:09.400072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bde17-4b97-4f8b-845f-0b9dd52274b5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:09.400463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bde17-4b97-4f8b-845f-0b9dd52274b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:09.400809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bde17-4b97-4f8b-845f-0b9dd52274b5 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:09.402088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bde17-4b97-4f8b-845f-0b9dd52274b5 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:09.403174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd289fe-d8d3-4e56-9769-87f3f6dbbcf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:09.403782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bde17-4b97-4f8b-845f-0b9dd52274b5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:09.405025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd289fe-d8d3-4e56-9769-87f3f6dbbcf6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:09.405800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 47/89] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:09 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:09.406662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bde17-4b97-4f8b-845f-0b9dd52274b5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:09.421600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:09.444593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:09.532969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bde17-4b97-4f8b-845f-0b9dd52274b5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:09.550046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 43/90] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:09.551078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd289fe-d8d3-4e56-9769-87f3f6dbbcf6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:09.586920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ff03-3bb0-4a56-a2d0-7ae80616a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:09.587846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ff03-3bb0-4a56-a2d0-7ae80616a1db None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:09.588557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ff03-3bb0-4a56-a2d0-7ae80616a1db None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:09.589008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50ff03-3bb0-4a56-a2d0-7ae80616a1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:09.662355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd289fe-d8d3-4e56-9769-87f3f6dbbcf6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:09.673434 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:09.676784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50ff03-3bb0-4a56-a2d0-7ae80616a1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:09.678520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50ff03-3bb0-4a56-a2d0-7ae80616a1db None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:09.706531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:09.707828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:09.708289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:09.709240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:09.711043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] RBAC: Adding query filter params (role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=159c16b029f94d2d8a928099d7e0ff73, user.id=2fb468f388b34796930d45da65c93c90) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:09.711560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:09.713905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:09.722028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 44/91] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:09 2022] GET /identity/v3/role_assignments?user.id=2fb468f388b34796930d45da65c93c90&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:09.723080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:09.731195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:09.902281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 48/92] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:09.903171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ff03-3bb0-4a56-a2d0-7ae80616a1db None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:09.953903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa790f7d-bdf4-4a99-bbfb-86b5e3f72b41 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:10.025084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50ff03-3bb0-4a56-a2d0-7ae80616a1db None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:10.062259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:10.062895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:10.063187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:10.063471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:10.063801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:10.064224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] RBAC: Adding query filter params (role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=159c16b029f94d2d8a928099d7e0ff73, user.id=2fb468f388b34796930d45da65c93c90) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:10.064544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:10.066098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:10.073375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 45/93] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:09 2022] GET /identity/v3/role_assignments?user.id=2fb468f388b34796930d45da65c93c90&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=9d32107ec65445988af384e49812cfa7 => generated 259 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:10.074429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:10.083432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0aa7-bf98-4115-a7c9-86ecce89796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:10.084924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0aa7-bf98-4115-a7c9-86ecce89796c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:10.085234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0aa7-bf98-4115-a7c9-86ecce89796c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:10.085537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb0aa7-bf98-4115-a7c9-86ecce89796c None admin] PATH_INFO: `/v3/projects/8dffd45c43d84b93998a644084702e4e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:10.090514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb0aa7-bf98-4115-a7c9-86ecce89796c None admin] RBAC: Authorizing `identity:get_project(project_id=8dffd45c43d84b93998a644084702e4e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:10.093954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb0aa7-bf98-4115-a7c9-86ecce89796c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:10.095794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 49/94] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:09 2022] GET /identity/v3/projects/8dffd45c43d84b93998a644084702e4e => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:10.103171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0aa7-bf98-4115-a7c9-86ecce89796c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:10.162561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:10.279676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f121c87-bb60-4e81-9387-213704a9d261 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:10.295285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb0aa7-bf98-4115-a7c9-86ecce89796c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:10.351520 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ead74-ad10-4685-a24a-0637e30cdc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:10.352179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead74-ad10-4685-a24a-0637e30cdc8b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:10.352466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead74-ad10-4685-a24a-0637e30cdc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:10.352745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead74-ad10-4685-a24a-0637e30cdc8b None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:10.354077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ead74-ad10-4685-a24a-0637e30cdc8b None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:10.356720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ead74-ad10-4685-a24a-0637e30cdc8b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:10.358525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 46/95] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:10 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:10.361867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab687ae-d8f5-497a-ab8a-a50f51393c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:10.362506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab687ae-d8f5-497a-ab8a-a50f51393c9f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:10.362794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab687ae-d8f5-497a-ab8a-a50f51393c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:10.363072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab687ae-d8f5-497a-ab8a-a50f51393c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:10.363920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab687ae-d8f5-497a-ab8a-a50f51393c9f None admin] RBAC: Adding query filter params (role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=8dffd45c43d84b93998a644084702e4e, user.id=2fb468f388b34796930d45da65c93c90) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:10.364243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab687ae-d8f5-497a-ab8a-a50f51393c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:10.366200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ead74-ad10-4685-a24a-0637e30cdc8b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:10.367794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab687ae-d8f5-497a-ab8a-a50f51393c9f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:10.393554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 50/96] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:10 2022] GET /identity/v3/role_assignments?user.id=2fb468f388b34796930d45da65c93c90&scope.project.id=8dffd45c43d84b93998a644084702e4e&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:10.552702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ead74-ad10-4685-a24a-0637e30cdc8b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:10.561211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:10.603154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eef5e-1394-4367-ac24-4b72b267aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:10.603777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eef5e-1394-4367-ac24-4b72b267aa0b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:10.604065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eef5e-1394-4367-ac24-4b72b267aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:10.604351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eef5e-1394-4367-ac24-4b72b267aa0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:10.605087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eef5e-1394-4367-ac24-4b72b267aa0b None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=159c16b029f94d2d8a928099d7e0ff73, user.id=47b8fe7c355f40a8aebb0296c911e10a) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:10.605404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eef5e-1394-4367-ac24-4b72b267aa0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:10.606886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eef5e-1394-4367-ac24-4b72b267aa0b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:10.612957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 47/97] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:10 2022] GET /identity/v3/role_assignments?user.id=47b8fe7c355f40a8aebb0296c911e10a&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:11.196480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7006ea-08eb-4d33-a974-353a8fc80398 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:11.197003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7006ea-08eb-4d33-a974-353a8fc80398 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:11.197075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7006ea-08eb-4d33-a974-353a8fc80398 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:11.198594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 51/98] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:11.204329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6fe75-c4a8-4f4f-82e7-e0fc6723e631 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:11.204776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6fe75-c4a8-4f4f-82e7-e0fc6723e631 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:11.204951 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6fe75-c4a8-4f4f-82e7-e0fc6723e631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:11.231854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-aae6fe75-c4a8-4f4f-82e7-e0fc6723e631 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:11.233143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-aae6fe75-c4a8-4f4f-82e7-e0fc6723e631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:11.248865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627ff8-90d9-4c02-9790-c9475059cfb4 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:11.249163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627ff8-90d9-4c02-9790-c9475059cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:11.249431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627ff8-90d9-4c02-9790-c9475059cfb4 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:11.250982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 52/99] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:11.255971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf640-ac29-4656-b83d-5c47d3fc6912 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:11.256792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf640-ac29-4656-b83d-5c47d3fc6912 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:11.257075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacf640-ac29-4656-b83d-5c47d3fc6912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:11.289375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7aacf640-ac29-4656-b83d-5c47d3fc6912 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:11.291438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7aacf640-ac29-4656-b83d-5c47d3fc6912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:11.372607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 48/100] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:11.407598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:11.427062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 53/101] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:11.686152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6fe75-c4a8-4f4f-82e7-e0fc6723e631 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:11.845324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:11.849156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6fe75-c4a8-4f4f-82e7-e0fc6723e631 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:11.898125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db7e71-8c98-44f0-9505-fed28d17c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:11.899126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7e71-8c98-44f0-9505-fed28d17c37c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:11.899601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7e71-8c98-44f0-9505-fed28d17c37c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:11.900062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db7e71-8c98-44f0-9505-fed28d17c37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:11.901415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db7e71-8c98-44f0-9505-fed28d17c37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:11.903118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db7e71-8c98-44f0-9505-fed28d17c37c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:11.905006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 49/102] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:11.910881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacf640-ac29-4656-b83d-5c47d3fc6912 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:11.923830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db7e71-8c98-44f0-9505-fed28d17c37c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:12.149401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacf640-ac29-4656-b83d-5c47d3fc6912 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:12.163610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db7e71-8c98-44f0-9505-fed28d17c37c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:12.221894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585972-d7e9-4ec5-a928-69b67d30f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:12.223378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585972-d7e9-4ec5-a928-69b67d30f7fc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:12.223946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585972-d7e9-4ec5-a928-69b67d30f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:12.224452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8585972-d7e9-4ec5-a928-69b67d30f7fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:12.240295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c6969-bc5e-41ba-93db-afa34c7fd43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:12.241738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6969-bc5e-41ba-93db-afa34c7fd43d None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:12.242172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6969-bc5e-41ba-93db-afa34c7fd43d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:12.242632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6969-bc5e-41ba-93db-afa34c7fd43d None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:12.243509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c6969-bc5e-41ba-93db-afa34c7fd43d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:12.245154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c6969-bc5e-41ba-93db-afa34c7fd43d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:12.247867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8585972-d7e9-4ec5-a928-69b67d30f7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f8585972-d7e9-4ec5-a928-69b67d30f7fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:12.257439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:12.258597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:12.259617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:12.261798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 50/103] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:24:12.272602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585972-d7e9-4ec5-a928-69b67d30f7fc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:12.314087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 54/104] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:24:11 2022] POST /identity/v3/projects => generated 302 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:12.320276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:12.418533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8585972-d7e9-4ec5-a928-69b67d30f7fc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:12.462806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc812-1751-454e-9c2f-808df4bf7f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:12.463521 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc812-1751-454e-9c2f-808df4bf7f85 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:12.463804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc812-1751-454e-9c2f-808df4bf7f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:12.464083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc812-1751-454e-9c2f-808df4bf7f85 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:12.464835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cc812-1751-454e-9c2f-808df4bf7f85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:12.465153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cc812-1751-454e-9c2f-808df4bf7f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:12.466655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cc812-1751-454e-9c2f-808df4bf7f85 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:12.477014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 51/105] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:12.483464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c6969-bc5e-41ba-93db-afa34c7fd43d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:12.484581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fed69-ff9c-42d8-8b48-ce97d5cd2d46 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:12.484873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fed69-ff9c-42d8-8b48-ce97d5cd2d46 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:12.485156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fed69-ff9c-42d8-8b48-ce97d5cd2d46 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:12.486739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 52/106] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:12.496885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26ce0-eacc-4df9-a8a5-14fde0dc6372 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:12.497171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26ce0-eacc-4df9-a8a5-14fde0dc6372 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:12.497453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f26ce0-eacc-4df9-a8a5-14fde0dc6372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:12.539054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-50f26ce0-eacc-4df9-a8a5-14fde0dc6372 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:12.540567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-50f26ce0-eacc-4df9-a8a5-14fde0dc6372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:12.569119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:12.691418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c6969-bc5e-41ba-93db-afa34c7fd43d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:12.696798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 53/107] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:12.738824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d4a39-f1a7-42da-ad56-5c6aed05a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:12.739488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4a39-f1a7-42da-ad56-5c6aed05a554 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:12.739777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4a39-f1a7-42da-ad56-5c6aed05a554 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:12.740061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d4a39-f1a7-42da-ad56-5c6aed05a554 None admin] PATH_INFO: `/v3/users/9309c1b0c7db43a08bfe3d8207db2bd7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:12.762295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d4a39-f1a7-42da-ad56-5c6aed05a554 None admin] RBAC: Authorizing `identity:get_user(user_id=9309c1b0c7db43a08bfe3d8207db2bd7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:12.763859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d4a39-f1a7-42da-ad56-5c6aed05a554 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:12.766096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 55/108] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:12 2022] GET /identity/v3/users/9309c1b0c7db43a08bfe3d8207db2bd7 => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:12.771496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f26ce0-eacc-4df9-a8a5-14fde0dc6372 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:12.797047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:12.892634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f26ce0-eacc-4df9-a8a5-14fde0dc6372 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:12.938764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8c005-56f6-4597-ae77-7e2f19cf163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:12.939388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8c005-56f6-4597-ae77-7e2f19cf163e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:12.939679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8c005-56f6-4597-ae77-7e2f19cf163e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:12.939958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8c005-56f6-4597-ae77-7e2f19cf163e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:13.031870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8c005-56f6-4597-ae77-7e2f19cf163e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:13.033401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8c005-56f6-4597-ae77-7e2f19cf163e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:13.060506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:13.164632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 54/109] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:13.174639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d4a39-f1a7-42da-ad56-5c6aed05a554 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:13.319296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:13.322604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d4a39-f1a7-42da-ad56-5c6aed05a554 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:13.369297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f9984-0ac3-482f-ba4f-abd7e105b644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:13.369979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f9984-0ac3-482f-ba4f-abd7e105b644 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:13.370268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f9984-0ac3-482f-ba4f-abd7e105b644 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:13.370807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f9984-0ac3-482f-ba4f-abd7e105b644 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:13.373398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f9984-0ac3-482f-ba4f-abd7e105b644 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:13.373713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8c005-56f6-4597-ae77-7e2f19cf163e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:13.377537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f9984-0ac3-482f-ba4f-abd7e105b644 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:13.377537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 56/110] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:13 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:13.384191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f9984-0ac3-482f-ba4f-abd7e105b644 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:13.581608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8c005-56f6-4597-ae77-7e2f19cf163e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:13.610343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f9984-0ac3-482f-ba4f-abd7e105b644 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:13.625061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:13.652222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f332d5-1d6b-4523-ba7d-6caf8150fd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:13.653104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f332d5-1d6b-4523-ba7d-6caf8150fd1a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:13.653586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f332d5-1d6b-4523-ba7d-6caf8150fd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:13.654062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f332d5-1d6b-4523-ba7d-6caf8150fd1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:13.676724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f332d5-1d6b-4523-ba7d-6caf8150fd1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-a7f332d5-1d6b-4523-ba7d-6caf8150fd1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:13.682213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:13.683070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:13.683815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:13.686207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 55/111] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:13.699736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f332d5-1d6b-4523-ba7d-6caf8150fd1a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:13.714530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92127a-fd06-4434-af12-5a997b87f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:13.715194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92127a-fd06-4434-af12-5a997b87f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:13.715564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92127a-fd06-4434-af12-5a997b87f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:13.715928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92127a-fd06-4434-af12-5a997b87f4d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:13.716794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92127a-fd06-4434-af12-5a997b87f4d6 None admin] RBAC: Adding query filter params (role.id=4c92d05fadd144138dd605c7f197e36a, scope.project.id=159c16b029f94d2d8a928099d7e0ff73, user.id=9309c1b0c7db43a08bfe3d8207db2bd7) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:13.717199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92127a-fd06-4434-af12-5a997b87f4d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:13.718889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92127a-fd06-4434-af12-5a997b87f4d6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:13.746078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 57/112] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:13 2022] GET /identity/v3/role_assignments?user.id=9309c1b0c7db43a08bfe3d8207db2bd7&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=4c92d05fadd144138dd605c7f197e36a => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:13.835643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aa39b-3c3c-47f2-9b8b-cc200c29f9cb None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:13.836186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aa39b-3c3c-47f2-9b8b-cc200c29f9cb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:13.836635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aa39b-3c3c-47f2-9b8b-cc200c29f9cb None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:13.838316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 58/113] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:13.844020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79478-e200-4244-b27c-e5a27c8afb25 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:13.844618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79478-e200-4244-b27c-e5a27c8afb25 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:13.845154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d79478-e200-4244-b27c-e5a27c8afb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:13.872750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-46d79478-e200-4244-b27c-e5a27c8afb25 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:13.878945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-46d79478-e200-4244-b27c-e5a27c8afb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:13.886471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f332d5-1d6b-4523-ba7d-6caf8150fd1a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:13.932306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:13.972680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d94a9-fe19-471a-930b-1ce68dfc10db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:13.973316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d94a9-fe19-471a-930b-1ce68dfc10db None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:13.973635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d94a9-fe19-471a-930b-1ce68dfc10db None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:13.973914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d94a9-fe19-471a-930b-1ce68dfc10db None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:13.974677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d94a9-fe19-471a-930b-1ce68dfc10db None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:13.974991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d94a9-fe19-471a-930b-1ce68dfc10db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:13.976473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d94a9-fe19-471a-930b-1ce68dfc10db None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:13.997389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 56/114] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:13.998855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa688a0e-02b7-4cb0-80cf-52390e9dc183 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:13.999187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa688a0e-02b7-4cb0-80cf-52390e9dc183 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:13.999559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa688a0e-02b7-4cb0-80cf-52390e9dc183 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.000913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 57/115] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:14.001684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa688a0e-02b7-4cb0-80cf-52390e9dc183 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:14.027063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 59/116] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:14.029457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458598-485c-48e7-a135-c6ea96ac4b04 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:14.029457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458598-485c-48e7-a135-c6ea96ac4b04 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:14.029457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458598-485c-48e7-a135-c6ea96ac4b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.072291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-16458598-485c-48e7-a135-c6ea96ac4b04 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:14.073497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-16458598-485c-48e7-a135-c6ea96ac4b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:14.111182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:14.171928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 60/117] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:14.173317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3c7de-bfb5-4f0f-a2a0-f9e8df5546b3 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:14.173628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3c7de-bfb5-4f0f-a2a0-f9e8df5546b3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:14.173907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3c7de-bfb5-4f0f-a2a0-f9e8df5546b3 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.175191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 61/118] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:14.183008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832578b-bfe4-4662-85fa-a67b69f69d9f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:14.183304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832578b-bfe4-4662-85fa-a67b69f69d9f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:14.183546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832578b-bfe4-4662-85fa-a67b69f69d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.222556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3832578b-bfe4-4662-85fa-a67b69f69d9f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:14.223987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3832578b-bfe4-4662-85fa-a67b69f69d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:14.228694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa688a0e-02b7-4cb0-80cf-52390e9dc183 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:14.317211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1506b4-f135-4cb4-80d2-44fdfaffce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:14.318011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1506b4-f135-4cb4-80d2-44fdfaffce83 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:14.318340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1506b4-f135-4cb4-80d2-44fdfaffce83 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:14.318621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1506b4-f135-4cb4-80d2-44fdfaffce83 None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.322291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1506b4-f135-4cb4-80d2-44fdfaffce83 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:14.323781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1506b4-f135-4cb4-80d2-44fdfaffce83 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:14.325878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 58/119] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:14 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:14.330801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1506b4-f135-4cb4-80d2-44fdfaffce83 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:14.356871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 62/120] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:14.359127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832578b-bfe4-4662-85fa-a67b69f69d9f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:14.406023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:14.549770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1506b4-f135-4cb4-80d2-44fdfaffce83 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:14.569859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:14.571730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832578b-bfe4-4662-85fa-a67b69f69d9f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:14.610644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc8eeb-4f7e-41e1-b4b9-cd73271f1faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:14.611278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc8eeb-4f7e-41e1-b4b9-cd73271f1faa None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:14.611556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc8eeb-4f7e-41e1-b4b9-cd73271f1faa None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:14.611833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc8eeb-4f7e-41e1-b4b9-cd73271f1faa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.622943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc8eeb-4f7e-41e1-b4b9-cd73271f1faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-4afc8eeb-4f7e-41e1-b4b9-cd73271f1faa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:14.628345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:14.629199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:14.630001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 59/121] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:14.635333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc8eeb-4f7e-41e1-b4b9-cd73271f1faa None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:14.647356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87c61d-0684-4bee-805c-891072e7f749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:14.648034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87c61d-0684-4bee-805c-891072e7f749 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:14.648320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87c61d-0684-4bee-805c-891072e7f749 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:14.648602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87c61d-0684-4bee-805c-891072e7f749 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.653462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87c61d-0684-4bee-805c-891072e7f749 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:14.655388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87c61d-0684-4bee-805c-891072e7f749 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:14.657190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 63/122] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:14 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:14.666660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87c61d-0684-4bee-805c-891072e7f749 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:14.773888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc8eeb-4f7e-41e1-b4b9-cd73271f1faa None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:14.808712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:14.819275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:14.820579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:14.821146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:14.821679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.822580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:14.822877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87c61d-0684-4bee-805c-891072e7f749 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:14.823304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:14.826358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:14.840853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 60/123] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:14.842425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:14.868154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e3946-701a-4b7f-bbb1-65d84c0538bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:14.869763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3946-701a-4b7f-bbb1-65d84c0538bd None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:14.870557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3946-701a-4b7f-bbb1-65d84c0538bd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:14.871082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e3946-701a-4b7f-bbb1-65d84c0538bd None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73/users/2fb468f388b34796930d45da65c93c90/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:14.874143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e3946-701a-4b7f-bbb1-65d84c0538bd None admin] RBAC: Authorizing `identity:create_grant(project_id=159c16b029f94d2d8a928099d7e0ff73, user_id=2fb468f388b34796930d45da65c93c90, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:14.876242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e3946-701a-4b7f-bbb1-65d84c0538bd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:14.887584 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:14.900609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 64/124] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:14 2022] PUT /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73/users/2fb468f388b34796930d45da65c93c90/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:14.902348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e3946-701a-4b7f-bbb1-65d84c0538bd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:14.986772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d0553-e5ba-4544-b100-c8237b83a44c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.076956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c064-4584-48db-9b81-f0a023c3e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.077637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c064-4584-48db-9b81-f0a023c3e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.077920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c064-4584-48db-9b81-f0a023c3e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.078194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244c064-4584-48db-9b81-f0a023c3e8b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.099525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244c064-4584-48db-9b81-f0a023c3e8b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:15.101637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e3946-701a-4b7f-bbb1-65d84c0538bd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f244c064-4584-48db-9b81-f0a023c3e8b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:15.105870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:15.106763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:15.107582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:15.110554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 61/125] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:15.111799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c064-4584-48db-9b81-f0a023c3e8b6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:15.142618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc184-b6f0-4de3-a796-c7e6a347b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.143264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc184-b6f0-4de3-a796-c7e6a347b59d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.143548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc184-b6f0-4de3-a796-c7e6a347b59d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.143819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fc184-b6f0-4de3-a796-c7e6a347b59d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.158067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46fc184-b6f0-4de3-a796-c7e6a347b59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a46fc184-b6f0-4de3-a796-c7e6a347b59d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:15.163754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:15.164703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:15.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 65/126] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:24:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:15.166165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc184-b6f0-4de3-a796-c7e6a347b59d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:15.181104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:15.243829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:15.259710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244c064-4584-48db-9b81-f0a023c3e8b6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.303798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fc184-b6f0-4de3-a796-c7e6a347b59d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.305999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b82d1-291a-459b-bba1-820d1a3cf725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.306803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b82d1-291a-459b-bba1-820d1a3cf725 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.307241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b82d1-291a-459b-bba1-820d1a3cf725 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.307640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b82d1-291a-459b-bba1-820d1a3cf725 None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.309038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b82d1-291a-459b-bba1-820d1a3cf725 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:15.311812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b82d1-291a-459b-bba1-820d1a3cf725 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:15.314153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 62/127] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:15 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:15.315254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b82d1-291a-459b-bba1-820d1a3cf725 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:15.395698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.396378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.396658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.396936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.397652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:15.398003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:15.399411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:15.413739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 66/128] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:15.415929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:15.506804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:15.511519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b82d1-291a-459b-bba1-820d1a3cf725 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.539329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ef4f9-a623-4c79-b2d9-2d6cbaee4609 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.580730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dbcff-528a-419c-abdb-013c52413eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.581508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dbcff-528a-419c-abdb-013c52413eff None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.581881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dbcff-528a-419c-abdb-013c52413eff None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.582160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dbcff-528a-419c-abdb-013c52413eff None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.583454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dbcff-528a-419c-abdb-013c52413eff None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:15.585061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dbcff-528a-419c-abdb-013c52413eff None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:15.587186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 67/129] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:15 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:15.588025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dbcff-528a-419c-abdb-013c52413eff None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:15.630950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.631599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.631864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.632142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.632822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:15.633131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:15.634560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:15.651031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 63/130] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:15.651881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:15.697950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:15.699696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dbcff-528a-419c-abdb-013c52413eff None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.744577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feb135-824f-403f-b84b-0ac87a321379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.745486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feb135-824f-403f-b84b-0ac87a321379 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.745794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feb135-824f-403f-b84b-0ac87a321379 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.746072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feb135-824f-403f-b84b-0ac87a321379 None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.747913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feb135-824f-403f-b84b-0ac87a321379 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:15.749658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feb135-824f-403f-b84b-0ac87a321379 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:15.751403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 68/131] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:15 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:15.752320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feb135-824f-403f-b84b-0ac87a321379 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:15.766072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:15.807900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba45a9a-ec8a-4198-b0a3-6a3f9ea88825 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.859751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f9d09-eb8b-4193-bc97-647be7c5c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.861234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f9d09-eb8b-4193-bc97-647be7c5c9a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.862158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f9d09-eb8b-4193-bc97-647be7c5c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.862474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f9d09-eb8b-4193-bc97-647be7c5c9a3 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73/users/2fb468f388b34796930d45da65c93c90/roles/9d32107ec65445988af384e49812cfa7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.866452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f9d09-eb8b-4193-bc97-647be7c5c9a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=159c16b029f94d2d8a928099d7e0ff73, user_id=2fb468f388b34796930d45da65c93c90, role_id=9d32107ec65445988af384e49812cfa7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:15.867960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f9d09-eb8b-4193-bc97-647be7c5c9a3 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:15.886215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feb135-824f-403f-b84b-0ac87a321379 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:15.891897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 64/132] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:15 2022] PUT /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73/users/2fb468f388b34796930d45da65c93c90/roles/9d32107ec65445988af384e49812cfa7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:15.894431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a825d-48bd-49da-a8d5-c3c6de66f98d None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.894836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a825d-48bd-49da-a8d5-c3c6de66f98d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.895353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a825d-48bd-49da-a8d5-c3c6de66f98d None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.897885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 65/133] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:15.898719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a825d-48bd-49da-a8d5-c3c6de66f98d None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:15.937504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e4cab-b712-410b-9df7-fd118f708856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:15.938540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e4cab-b712-410b-9df7-fd118f708856 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.938899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e4cab-b712-410b-9df7-fd118f708856 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.939270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e4cab-b712-410b-9df7-fd118f708856 None admin] PATH_INFO: `/v3/users/47b8fe7c355f40a8aebb0296c911e10a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.940936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e4cab-b712-410b-9df7-fd118f708856 None admin] RBAC: Authorizing `identity:get_user(user_id=47b8fe7c355f40a8aebb0296c911e10a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:15.943535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e4cab-b712-410b-9df7-fd118f708856 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:15.945990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 69/134] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:15 2022] GET /identity/v3/users/47b8fe7c355f40a8aebb0296c911e10a => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:15.947769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab819e3b-9d02-421f-a97c-3b99c0156c6b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:15.948390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab819e3b-9d02-421f-a97c-3b99c0156c6b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:15.948739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab819e3b-9d02-421f-a97c-3b99c0156c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:15.974013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ab819e3b-9d02-421f-a97c-3b99c0156c6b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:15.977676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ab819e3b-9d02-421f-a97c-3b99c0156c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:16.013502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:16.040488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a825d-48bd-49da-a8d5-c3c6de66f98d None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:16.090801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53012ac0-ee10-4ec8-a3db-7064c0d7a242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:16.091939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 70/135] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:16.092719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53012ac0-ee10-4ec8-a3db-7064c0d7a242 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:16.093846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab819e3b-9d02-421f-a97c-3b99c0156c6b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:16.094333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53012ac0-ee10-4ec8-a3db-7064c0d7a242 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:16.094784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53012ac0-ee10-4ec8-a3db-7064c0d7a242 None admin] PATH_INFO: `/v3/projects/8dffd45c43d84b93998a644084702e4e` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:16.096871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53012ac0-ee10-4ec8-a3db-7064c0d7a242 None admin] RBAC: Authorizing `identity:get_project(project_id=8dffd45c43d84b93998a644084702e4e)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:16.112782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53012ac0-ee10-4ec8-a3db-7064c0d7a242 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:16.115126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 66/136] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:15 2022] GET /identity/v3/projects/8dffd45c43d84b93998a644084702e4e => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:16.126228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:16.126412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53012ac0-ee10-4ec8-a3db-7064c0d7a242 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:16.254147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab819e3b-9d02-421f-a97c-3b99c0156c6b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:16.296634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01016cd9-1aa4-44ff-afc4-f4158ee47ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:16.297210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016cd9-1aa4-44ff-afc4-f4158ee47ace None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:16.297494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016cd9-1aa4-44ff-afc4-f4158ee47ace None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:16.297817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01016cd9-1aa4-44ff-afc4-f4158ee47ace None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:16.299596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01016cd9-1aa4-44ff-afc4-f4158ee47ace None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:16.301231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01016cd9-1aa4-44ff-afc4-f4158ee47ace None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:16.301398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53012ac0-ee10-4ec8-a3db-7064c0d7a242 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:16.303194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 71/137] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:16 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:16.309023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01016cd9-1aa4-44ff-afc4-f4158ee47ace None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:16.368372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e7717-6327-4ae6-8545-b33c5f7893ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:16.369046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e7717-6327-4ae6-8545-b33c5f7893ff None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:16.369333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e7717-6327-4ae6-8545-b33c5f7893ff None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:16.369637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e7717-6327-4ae6-8545-b33c5f7893ff None admin] PATH_INFO: `/v3/projects/8dffd45c43d84b93998a644084702e4e/users/2fb468f388b34796930d45da65c93c90/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:16.374681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e7717-6327-4ae6-8545-b33c5f7893ff None admin] RBAC: Authorizing `identity:create_grant(project_id=8dffd45c43d84b93998a644084702e4e, user_id=2fb468f388b34796930d45da65c93c90, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:16.376148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e7717-6327-4ae6-8545-b33c5f7893ff None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:16.401386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 67/138] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:16 2022] PUT /identity/v3/projects/8dffd45c43d84b93998a644084702e4e/users/2fb468f388b34796930d45da65c93c90/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:16.444381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:16.477773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01016cd9-1aa4-44ff-afc4-f4158ee47ace None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:16.522079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc1fe5-eb0f-45ba-b616-2dd81974fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:16.522836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1fe5-eb0f-45ba-b616-2dd81974fa09 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:16.523126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1fe5-eb0f-45ba-b616-2dd81974fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:16.523404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc1fe5-eb0f-45ba-b616-2dd81974fa09 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73/users/47b8fe7c355f40a8aebb0296c911e10a/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:16.526866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc1fe5-eb0f-45ba-b616-2dd81974fa09 None admin] RBAC: Authorizing `identity:create_grant(project_id=159c16b029f94d2d8a928099d7e0ff73, user_id=47b8fe7c355f40a8aebb0296c911e10a, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:16.528396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc1fe5-eb0f-45ba-b616-2dd81974fa09 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:16.547699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 72/139] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:16 2022] PUT /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73/users/47b8fe7c355f40a8aebb0296c911e10a/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:24:16.625054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e7717-6327-4ae6-8545-b33c5f7893ff None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:16.641786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:16.781232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e7717-6327-4ae6-8545-b33c5f7893ff None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:16.840420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd5dfb-8b7f-4b3e-b160-571287e44c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:16.841330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5dfb-8b7f-4b3e-b160-571287e44c52 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:16.841810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5dfb-8b7f-4b3e-b160-571287e44c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:16.842231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd5dfb-8b7f-4b3e-b160-571287e44c52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:16.843700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd5dfb-8b7f-4b3e-b160-571287e44c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:16.845668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd5dfb-8b7f-4b3e-b160-571287e44c52 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:16.847504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 68/140] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:16.856734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc1fe5-eb0f-45ba-b616-2dd81974fa09 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:16.972705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154be3ba-3175-4e63-a218-c6b6b405827a None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:16.973215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154be3ba-3175-4e63-a218-c6b6b405827a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:16.973662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154be3ba-3175-4e63-a218-c6b6b405827a None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:16.975863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 69/141] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:16.982072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978a119-1bf2-4a29-a79b-7e91f4347472 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:16.982560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978a119-1bf2-4a29-a79b-7e91f4347472 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:16.982982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978a119-1bf2-4a29-a79b-7e91f4347472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:17.003574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc1fe5-eb0f-45ba-b616-2dd81974fa09 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:17.014676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8978a119-1bf2-4a29-a79b-7e91f4347472 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:17.016015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8978a119-1bf2-4a29-a79b-7e91f4347472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:17.045222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab3286-24fe-447e-836c-5f76f15182e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:17.046329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab3286-24fe-447e-836c-5f76f15182e3 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:17.046836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab3286-24fe-447e-836c-5f76f15182e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:17.047300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab3286-24fe-447e-836c-5f76f15182e3 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:17.048148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab3286-24fe-447e-836c-5f76f15182e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:17.050017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab3286-24fe-447e-836c-5f76f15182e3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:17.059047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:17.077681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 73/142] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:24:16 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:17.134895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 70/143] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:17.612778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab3286-24fe-447e-836c-5f76f15182e3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:17.726954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab3286-24fe-447e-836c-5f76f15182e3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:17.764635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778740e-447c-4999-a7f5-ec5a031ebb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:17.765284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778740e-447c-4999-a7f5-ec5a031ebb9a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:17.765588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778740e-447c-4999-a7f5-ec5a031ebb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:17.765870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778740e-447c-4999-a7f5-ec5a031ebb9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:17.776609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778740e-447c-4999-a7f5-ec5a031ebb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8778740e-447c-4999-a7f5-ec5a031ebb9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:17.786034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:17.786983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:17.787857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:17.788991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 74/144] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:17.796166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978a119-1bf2-4a29-a79b-7e91f4347472 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:17.816566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:17.935691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978a119-1bf2-4a29-a79b-7e91f4347472 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:17.976448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac154eb-be46-403e-a46b-47d254f72534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:17.977132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac154eb-be46-403e-a46b-47d254f72534 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:17.977420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac154eb-be46-403e-a46b-47d254f72534 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:17.977761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac154eb-be46-403e-a46b-47d254f72534 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:17.978470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac154eb-be46-403e-a46b-47d254f72534 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:17.978784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac154eb-be46-403e-a46b-47d254f72534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:17.980264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac154eb-be46-403e-a46b-47d254f72534 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:17.993258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 71/145] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:17.999547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778740e-447c-4999-a7f5-ec5a031ebb9a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:18.084810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:18.126907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d8dbc-72d4-4d9d-960c-0061cb8c3369 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:18.127254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d8dbc-72d4-4d9d-960c-0061cb8c3369 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:18.127473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d8dbc-72d4-4d9d-960c-0061cb8c3369 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:18.128920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 72/146] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:18.134730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c132bd-28a3-453d-bbaa-f5249e961a74 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:18.135021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c132bd-28a3-453d-bbaa-f5249e961a74 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:18.135293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c132bd-28a3-453d-bbaa-f5249e961a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:18.148426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778740e-447c-4999-a7f5-ec5a031ebb9a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:18.168272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-66c132bd-28a3-453d-bbaa-f5249e961a74 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:18.169526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-66c132bd-28a3-453d-bbaa-f5249e961a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:18.195326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961bab-878e-4b29-880a-d8d5849c1efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:18.196366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961bab-878e-4b29-880a-d8d5849c1efa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:18.196933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961bab-878e-4b29-880a-d8d5849c1efa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:18.197468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc961bab-878e-4b29-880a-d8d5849c1efa None admin] PATH_INFO: `/v3/users/9309c1b0c7db43a08bfe3d8207db2bd7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:18.199199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc961bab-878e-4b29-880a-d8d5849c1efa None admin] RBAC: Authorizing `identity:get_user(user_id=9309c1b0c7db43a08bfe3d8207db2bd7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:18.201274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc961bab-878e-4b29-880a-d8d5849c1efa None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:18.203966 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 75/147] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:17 2022] GET /identity/v3/users/9309c1b0c7db43a08bfe3d8207db2bd7 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:18.211165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961bab-878e-4b29-880a-d8d5849c1efa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:18.321549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:18.327662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 73/148] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:18.417468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc961bab-878e-4b29-880a-d8d5849c1efa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:18.455255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:18.489244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94628-36c0-4271-a387-abe5c9962c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:18.490013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94628-36c0-4271-a387-abe5c9962c43 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:18.490295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94628-36c0-4271-a387-abe5c9962c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:18.490571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94628-36c0-4271-a387-abe5c9962c43 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:18.491921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb94628-36c0-4271-a387-abe5c9962c43 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:18.493416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb94628-36c0-4271-a387-abe5c9962c43 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:18.495897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 76/149] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:18 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:18.501905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c132bd-28a3-453d-bbaa-f5249e961a74 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:18.715301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c132bd-28a3-453d-bbaa-f5249e961a74 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:18.735878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94628-36c0-4271-a387-abe5c9962c43 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:18.787972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257736aa-1bd8-47c1-abc6-3d16b84cfbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:18.788989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257736aa-1bd8-47c1-abc6-3d16b84cfbb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:18.789416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257736aa-1bd8-47c1-abc6-3d16b84cfbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:18.789867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257736aa-1bd8-47c1-abc6-3d16b84cfbb2 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73/users/9309c1b0c7db43a08bfe3d8207db2bd7/roles/4c92d05fadd144138dd605c7f197e36a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:18.795593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257736aa-1bd8-47c1-abc6-3d16b84cfbb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=159c16b029f94d2d8a928099d7e0ff73, user_id=9309c1b0c7db43a08bfe3d8207db2bd7, role_id=4c92d05fadd144138dd605c7f197e36a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:18.798030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257736aa-1bd8-47c1-abc6-3d16b84cfbb2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:18.838722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 74/150] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:18 2022] PUT /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73/users/9309c1b0c7db43a08bfe3d8207db2bd7/roles/4c92d05fadd144138dd605c7f197e36a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:18.840045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162bf7-46ad-4460-b8ad-dfb82016fdb2 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:18.840357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162bf7-46ad-4460-b8ad-dfb82016fdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:18.840636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162bf7-46ad-4460-b8ad-dfb82016fdb2 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:18.841967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 75/151] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:18.850257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8574e-939b-4915-a6a6-8af9ad265ac2 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:18.850661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8574e-939b-4915-a6a6-8af9ad265ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:18.851057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8574e-939b-4915-a6a6-8af9ad265ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:18.871486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94628-36c0-4271-a387-abe5c9962c43 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:18.891072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-edd8574e-939b-4915-a6a6-8af9ad265ac2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:18.892304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-edd8574e-939b-4915-a6a6-8af9ad265ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:18.928766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba870-0c76-42fa-b1da-e086bfc019a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:18.929442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba870-0c76-42fa-b1da-e086bfc019a2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:18.929755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba870-0c76-42fa-b1da-e086bfc019a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:18.930028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dba870-0c76-42fa-b1da-e086bfc019a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:18.950654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dba870-0c76-42fa-b1da-e086bfc019a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-30dba870-0c76-42fa-b1da-e086bfc019a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:18.956347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:18.957325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:18.959312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 77/152] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:18.963991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba870-0c76-42fa-b1da-e086bfc019a2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:19.035227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:19.042989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:19.064282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 76/153] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:19.123013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dba870-0c76-42fa-b1da-e086bfc019a2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:19.173602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:19.174241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:19.174520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:19.174795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:19.175476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:19.175781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:19.177745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:19.187008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 78/154] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:19.193580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8574e-939b-4915-a6a6-8af9ad265ac2 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:19.326994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8574e-939b-4915-a6a6-8af9ad265ac2 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:19.376604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9754db-a35f-458e-bd68-b2544ca70765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:19.377255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754db-a35f-458e-bd68-b2544ca70765 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:19.377553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754db-a35f-458e-bd68-b2544ca70765 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:19.377836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9754db-a35f-458e-bd68-b2544ca70765 None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:19.378995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9754db-a35f-458e-bd68-b2544ca70765 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:19.380485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9754db-a35f-458e-bd68-b2544ca70765 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:19.382124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 77/155] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:19 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:19.387726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:19.559059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d013b-bff3-4a80-b8ea-0e0d604106d6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:19.569668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:19.605469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e3102-4b38-4743-a71a-ba00d807a84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:19.606143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3102-4b38-4743-a71a-ba00d807a84e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:19.606733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3102-4b38-4743-a71a-ba00d807a84e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:19.607014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3102-4b38-4743-a71a-ba00d807a84e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:19.719642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e3102-4b38-4743-a71a-ba00d807a84e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:19.721116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e3102-4b38-4743-a71a-ba00d807a84e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:19.754760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9754db-a35f-458e-bd68-b2544ca70765 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:19.894093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 79/156] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:19.900440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e3102-4b38-4743-a71a-ba00d807a84e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:19.905469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:19.917407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:20.013462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9754db-a35f-458e-bd68-b2544ca70765 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:20.068336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e3102-4b38-4743-a71a-ba00d807a84e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:20.087305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c74dc-44a5-4fe9-b411-f913eed64417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:20.087965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c74dc-44a5-4fe9-b411-f913eed64417 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.088262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c74dc-44a5-4fe9-b411-f913eed64417 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.088538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c74dc-44a5-4fe9-b411-f913eed64417 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:20.118684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c74dc-44a5-4fe9-b411-f913eed64417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-d50c74dc-44a5-4fe9-b411-f913eed64417 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:20.124424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:20.125437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:20.126459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 78/157] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:24:20.131965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c74dc-44a5-4fe9-b411-f913eed64417 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:20.158688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2863fe5-417d-4ba1-b824-e59231e98a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:20.159692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863fe5-417d-4ba1-b824-e59231e98a95 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.160189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863fe5-417d-4ba1-b824-e59231e98a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.160672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2863fe5-417d-4ba1-b824-e59231e98a95 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:20.163105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2863fe5-417d-4ba1-b824-e59231e98a95 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:20.164817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2863fe5-417d-4ba1-b824-e59231e98a95 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:20.166913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 80/158] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:19 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:20.172878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2863fe5-417d-4ba1-b824-e59231e98a95 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:20.310551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:20.357550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2863fe5-417d-4ba1-b824-e59231e98a95 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:20.372600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c74dc-44a5-4fe9-b411-f913eed64417 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:20.410776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:20.424273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77f649-33a1-4d91-a6d8-de12a17af019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:20.425283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f649-33a1-4d91-a6d8-de12a17af019 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.425784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f649-33a1-4d91-a6d8-de12a17af019 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.426285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f649-33a1-4d91-a6d8-de12a17af019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:20.427248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77f649-33a1-4d91-a6d8-de12a17af019 None admin] RBAC: Adding query filter params (role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=159c16b029f94d2d8a928099d7e0ff73, user.id=2fb468f388b34796930d45da65c93c90) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:20.427767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77f649-33a1-4d91-a6d8-de12a17af019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:20.429407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77f649-33a1-4d91-a6d8-de12a17af019 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:20.443218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 81/159] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:20 2022] GET /identity/v3/role_assignments?user.id=2fb468f388b34796930d45da65c93c90&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:20.445048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1552fb-ff79-40e3-8d26-5a617d56dd27 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.445570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1552fb-ff79-40e3-8d26-5a617d56dd27 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.446102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1552fb-ff79-40e3-8d26-5a617d56dd27 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:20.447612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 82/160] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:20.454878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31301b55-1128-4c11-b583-4ec816e3a383 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.455543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31301b55-1128-4c11-b583-4ec816e3a383 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.456015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31301b55-1128-4c11-b583-4ec816e3a383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:20.467540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:20.468197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.468482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.468764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:20.469477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:20.469814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:20.472640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:20.489096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 79/161] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:20.495494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-31301b55-1128-4c11-b583-4ec816e3a383 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:20.495796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:20.497242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-31301b55-1128-4c11-b583-4ec816e3a383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:20.653539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 83/162] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:20.736232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2e579-eea4-4d42-b304-cf2d4ef36024 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:20.787355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ea5be-74ad-46e7-ba1b-397715b31664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:20.788015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ea5be-74ad-46e7-ba1b-397715b31664 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.788301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ea5be-74ad-46e7-ba1b-397715b31664 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.788578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ea5be-74ad-46e7-ba1b-397715b31664 None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:20.789903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ea5be-74ad-46e7-ba1b-397715b31664 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:20.791393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ea5be-74ad-46e7-ba1b-397715b31664 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:20.793099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 80/163] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:20 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:20.798750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31301b55-1128-4c11-b583-4ec816e3a383 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:20.905370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:20.946550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31301b55-1128-4c11-b583-4ec816e3a383 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:20.959310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b44a3-fa3e-4444-b182-607faefd9080 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.959820 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b44a3-fa3e-4444-b182-607faefd9080 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.959896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b44a3-fa3e-4444-b182-607faefd9080 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:20.961482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 81/164] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:20.968347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4333b-84d7-4b08-b75d-c926b111ddb6 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:20.968648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4333b-84d7-4b08-b75d-c926b111ddb6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:20.968924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4333b-84d7-4b08-b75d-c926b111ddb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:21.001706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-30f4333b-84d7-4b08-b75d-c926b111ddb6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:21.002927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-30f4333b-84d7-4b08-b75d-c926b111ddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:21.009538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c2749-41e7-4ff9-929f-4f80f9e8740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:21.010177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c2749-41e7-4ff9-929f-4f80f9e8740e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:21.010462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c2749-41e7-4ff9-929f-4f80f9e8740e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:21.010739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c2749-41e7-4ff9-929f-4f80f9e8740e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:21.100487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:21.148208 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 82/165] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:21.149100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4333b-84d7-4b08-b75d-c926b111ddb6 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:21.170608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c2749-41e7-4ff9-929f-4f80f9e8740e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:21.172275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c2749-41e7-4ff9-929f-4f80f9e8740e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:21.324442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:21.341628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4333b-84d7-4b08-b75d-c926b111ddb6 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:21.388860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 84/166] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:21.394316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c2749-41e7-4ff9-929f-4f80f9e8740e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:21.417936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd43f-5889-4084-877c-73b60e3960b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:21.418940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd43f-5889-4084-877c-73b60e3960b1 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:21.419418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd43f-5889-4084-877c-73b60e3960b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:21.419912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd43f-5889-4084-877c-73b60e3960b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:21.441272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fd43f-5889-4084-877c-73b60e3960b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-749fd43f-5889-4084-877c-73b60e3960b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:21.446876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:21.447864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:21.448797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:21.451254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 83/167] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:21.457251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd43f-5889-4084-877c-73b60e3960b1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:21.532538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:21.638652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c2749-41e7-4ff9-929f-4f80f9e8740e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:21.689779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd43f-5889-4084-877c-73b60e3960b1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:21.721653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1d595-3e39-4946-b7fa-72f2cc0ab872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:21.722656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1d595-3e39-4946-b7fa-72f2cc0ab872 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:21.723154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1d595-3e39-4946-b7fa-72f2cc0ab872 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:21.723643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1d595-3e39-4946-b7fa-72f2cc0ab872 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:21.725730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1d595-3e39-4946-b7fa-72f2cc0ab872 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:21.727418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1d595-3e39-4946-b7fa-72f2cc0ab872 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:21.729422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 85/168] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:21 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:21.734522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1d595-3e39-4946-b7fa-72f2cc0ab872 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:21.768506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:21.769136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:21.769648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:21.769924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:21.771020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:21.771327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:21.772747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:21.792341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 84/169] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:21.793408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:21.829068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:21.992101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1d595-3e39-4946-b7fa-72f2cc0ab872 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:21.996014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9648f4-b053-4f04-a193-7522c79a263d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:22.003971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:22.079578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:22.080283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.080566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.080844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.081634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] RBAC: Adding query filter params (role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=159c16b029f94d2d8a928099d7e0ff73, user.id=2fb468f388b34796930d45da65c93c90) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:22.081949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:22.084372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:22.098989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ade317-9600-4523-8001-455ed9616fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:22.099671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ade317-9600-4523-8001-455ed9616fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.099956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ade317-9600-4523-8001-455ed9616fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.100232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ade317-9600-4523-8001-455ed9616fb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.101846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 85/170] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:21 2022] GET /identity/v3/role_assignments?user.id=2fb468f388b34796930d45da65c93c90&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=9d32107ec65445988af384e49812cfa7 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:22.102727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:22.138886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ade317-9600-4523-8001-455ed9616fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-59ade317-9600-4523-8001-455ed9616fb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:22.144352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:22.145334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:22.146604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 86/171] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:22.155340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ade317-9600-4523-8001-455ed9616fb6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:22.348128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ce150-90af-4b1a-8324-5a950e591b46 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:22.415563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:22.428242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ade317-9600-4523-8001-455ed9616fb6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:22.441320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9866f75-59fc-4976-b6af-ef3bd27902f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:22.441990 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9866f75-59fc-4976-b6af-ef3bd27902f5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.442272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9866f75-59fc-4976-b6af-ef3bd27902f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.442604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9866f75-59fc-4976-b6af-ef3bd27902f5 None admin] PATH_INFO: `/v3/users/47b8fe7c355f40a8aebb0296c911e10a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.445461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9866f75-59fc-4976-b6af-ef3bd27902f5 None admin] RBAC: Authorizing `identity:get_user(user_id=47b8fe7c355f40a8aebb0296c911e10a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:22.446950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9866f75-59fc-4976-b6af-ef3bd27902f5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:22.454500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 86/172] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:22 2022] GET /identity/v3/users/47b8fe7c355f40a8aebb0296c911e10a => generated 247 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:22.455488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9866f75-59fc-4976-b6af-ef3bd27902f5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:22.517742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:22.518382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.518717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.518923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.519609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:22.519914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:22.521370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:22.531301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:22.543490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 87/173] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:22.572434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:22.624270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9866f75-59fc-4976-b6af-ef3bd27902f5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:22.669226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573554d4-24ce-4ae9-ac72-49193b3d7276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:22.669891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573554d4-24ce-4ae9-ac72-49193b3d7276 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.670178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573554d4-24ce-4ae9-ac72-49193b3d7276 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.670455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573554d4-24ce-4ae9-ac72-49193b3d7276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.785241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573554d4-24ce-4ae9-ac72-49193b3d7276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:22.789616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573554d4-24ce-4ae9-ac72-49193b3d7276 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:22.795832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e7c2b-93bd-4eec-968e-0fc0f1744208 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:22.846926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:22.856303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f111-35ed-47be-86b0-cb0770149d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:22.857323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f111-35ed-47be-86b0-cb0770149d96 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.857687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f111-35ed-47be-86b0-cb0770149d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.858078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f111-35ed-47be-86b0-cb0770149d96 None admin] PATH_INFO: `/v3/users/2fb468f388b34796930d45da65c93c90` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.859535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f111-35ed-47be-86b0-cb0770149d96 None admin] RBAC: Authorizing `identity:get_user(user_id=2fb468f388b34796930d45da65c93c90)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:22.861004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f111-35ed-47be-86b0-cb0770149d96 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:22.864082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 88/174] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:22 2022] GET /identity/v3/users/2fb468f388b34796930d45da65c93c90 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:22.865839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99661-a1f5-42ca-89e6-c7635bd4174a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.866349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99661-a1f5-42ca-89e6-c7635bd4174a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.866846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99661-a1f5-42ca-89e6-c7635bd4174a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.868434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 89/175] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:22.870227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d5c2-049b-45a1-ba96-b036b41f8713 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.870747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d5c2-049b-45a1-ba96-b036b41f8713 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.871263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d5c2-049b-45a1-ba96-b036b41f8713 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.872893 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 90/176] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:22.878213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829d5c2-049b-45a1-ba96-b036b41f8713 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:22.921637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:22.941052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 87/177] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:22.945248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9aa8-3c63-445d-9f9b-b70676c5ce36 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:22.945550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9aa8-3c63-445d-9f9b-b70676c5ce36 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:22.945839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a9aa8-3c63-445d-9f9b-b70676c5ce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:22.971102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2b0a9aa8-3c63-445d-9f9b-b70676c5ce36 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:22.972307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2b0a9aa8-3c63-445d-9f9b-b70676c5ce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:23.008443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829d5c2-049b-45a1-ba96-b036b41f8713 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:23.050917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335feb9-ecec-4403-80ce-3e91ef72489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:23.051568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 88/178] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:23.052124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335feb9-ecec-4403-80ce-3e91ef72489b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.052532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335feb9-ecec-4403-80ce-3e91ef72489b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.052987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335feb9-ecec-4403-80ce-3e91ef72489b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.059097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd959d-adc5-4858-9375-cba1da0bd7bc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.059438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd959d-adc5-4858-9375-cba1da0bd7bc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.059715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd959d-adc5-4858-9375-cba1da0bd7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.097294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-23cd959d-adc5-4858-9375-cba1da0bd7bc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:23.100978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-23cd959d-adc5-4858-9375-cba1da0bd7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:23.176799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:23.188476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 89/179] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:23.189829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd959d-adc5-4858-9375-cba1da0bd7bc None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:23.232331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335feb9-ecec-4403-80ce-3e91ef72489b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:23.236264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335feb9-ecec-4403-80ce-3e91ef72489b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:23.309481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd959d-adc5-4858-9375-cba1da0bd7bc None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:23.319025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:23.372634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee5bb5-4d6f-4230-b801-da6972826547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:23.375505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5bb5-4d6f-4230-b801-da6972826547 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.375963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5bb5-4d6f-4230-b801-da6972826547 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.378554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee5bb5-4d6f-4230-b801-da6972826547 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.385869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee5bb5-4d6f-4230-b801-da6972826547 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:23.387286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee5bb5-4d6f-4230-b801-da6972826547 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:23.389317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 90/180] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:23 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:23.390602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe399-93fe-4aeb-a24e-a3d21afdf341 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.390891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe399-93fe-4aeb-a24e-a3d21afdf341 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.391170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfe399-93fe-4aeb-a24e-a3d21afdf341 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.392641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 91/181] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:23.394891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfe399-93fe-4aeb-a24e-a3d21afdf341 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:23.437202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 91/182] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:23.443718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495fbe5-d944-4041-ac58-75aee75a4e9d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.444181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495fbe5-d944-4041-ac58-75aee75a4e9d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.444628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495fbe5-d944-4041-ac58-75aee75a4e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.460768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:23.464818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d495fbe5-d944-4041-ac58-75aee75a4e9d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:23.466362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d495fbe5-d944-4041-ac58-75aee75a4e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:23.510915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfe399-93fe-4aeb-a24e-a3d21afdf341 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:23.550385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 92/183] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:23.551246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495fbe5-d944-4041-ac58-75aee75a4e9d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:23.551422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611715a-226d-4f2f-aa51-4886f3044ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:23.552658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611715a-226d-4f2f-aa51-4886f3044ccb None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.552939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611715a-226d-4f2f-aa51-4886f3044ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.553219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611715a-226d-4f2f-aa51-4886f3044ccb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.564907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611715a-226d-4f2f-aa51-4886f3044ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-d611715a-226d-4f2f-aa51-4886f3044ccb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:23.571607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:23.572519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:23.573314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 92/184] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:24:23.574663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611715a-226d-4f2f-aa51-4886f3044ccb None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:23.634003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:23.677789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495fbe5-d944-4041-ac58-75aee75a4e9d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:23.694893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611715a-226d-4f2f-aa51-4886f3044ccb None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:23.716363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:23.722334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a78b4-1e32-4871-8a07-6b8ed6569c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:23.723123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a78b4-1e32-4871-8a07-6b8ed6569c8a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.723764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a78b4-1e32-4871-8a07-6b8ed6569c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.724050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a78b4-1e32-4871-8a07-6b8ed6569c8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.724962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a78b4-1e32-4871-8a07-6b8ed6569c8a None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=159c16b029f94d2d8a928099d7e0ff73, user.id=47b8fe7c355f40a8aebb0296c911e10a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:23.725280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a78b4-1e32-4871-8a07-6b8ed6569c8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:23.726775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a78b4-1e32-4871-8a07-6b8ed6569c8a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:23.731865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32443ad-dc11-4091-ad37-35899d32b29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:23.732487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32443ad-dc11-4091-ad37-35899d32b29a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.732764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32443ad-dc11-4091-ad37-35899d32b29a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.733037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32443ad-dc11-4091-ad37-35899d32b29a None admin] PATH_INFO: `/v3/projects/8dffd45c43d84b93998a644084702e4e` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.735365 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 93/185] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:23 2022] GET /identity/v3/role_assignments?user.id=47b8fe7c355f40a8aebb0296c911e10a&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:23.736582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555abb9b-521c-491a-b796-e312d3a31c4b None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.736860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555abb9b-521c-491a-b796-e312d3a31c4b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.737129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555abb9b-521c-491a-b796-e312d3a31c4b None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.738244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32443ad-dc11-4091-ad37-35899d32b29a None admin] RBAC: Authorizing `identity:get_project(project_id=8dffd45c43d84b93998a644084702e4e)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:23.743264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 94/186] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:23.743264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555abb9b-521c-491a-b796-e312d3a31c4b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:23.745646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32443ad-dc11-4091-ad37-35899d32b29a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:23.747749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 93/187] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:23 2022] GET /identity/v3/projects/8dffd45c43d84b93998a644084702e4e => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:23.748859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32443ad-dc11-4091-ad37-35899d32b29a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:23.884777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32443ad-dc11-4091-ad37-35899d32b29a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:23.885540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555abb9b-521c-491a-b796-e312d3a31c4b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:23.921380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:23.923083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236d432-8db6-41cc-9ccd-10ca06f27449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:23.924212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236d432-8db6-41cc-9ccd-10ca06f27449 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.924212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236d432-8db6-41cc-9ccd-10ca06f27449 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.924212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236d432-8db6-41cc-9ccd-10ca06f27449 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.925031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236d432-8db6-41cc-9ccd-10ca06f27449 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:23.926079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236d432-8db6-41cc-9ccd-10ca06f27449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:23.927636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236d432-8db6-41cc-9ccd-10ca06f27449 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:23.937605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38cc99-5e31-43bb-94e8-225a2c6f8e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:23.940659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 94/188] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:23.940818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38cc99-5e31-43bb-94e8-225a2c6f8e06 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.940818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38cc99-5e31-43bb-94e8-225a2c6f8e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.940818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38cc99-5e31-43bb-94e8-225a2c6f8e06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.941035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366d6d-53d8-4a5a-84b6-49a4f48217c0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:23.941035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366d6d-53d8-4a5a-84b6-49a4f48217c0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:23.941035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366d6d-53d8-4a5a-84b6-49a4f48217c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:23.954354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38cc99-5e31-43bb-94e8-225a2c6f8e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:23.959172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ed366d6d-53d8-4a5a-84b6-49a4f48217c0 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7f38cc99-5e31-43bb-94e8-225a2c6f8e06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:23.959727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:23.960700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:23.961747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:23.962345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ed366d6d-53d8-4a5a-84b6-49a4f48217c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:23.962422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 95/189] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:23.963101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38cc99-5e31-43bb-94e8-225a2c6f8e06 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.015398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:24.037374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 95/190] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:24.047999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed366d6d-53d8-4a5a-84b6-49a4f48217c0 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.081206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38cc99-5e31-43bb-94e8-225a2c6f8e06 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.116816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.117558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.117908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.118188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.118917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] RBAC: Adding query filter params (role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=8dffd45c43d84b93998a644084702e4e, user.id=2fb468f388b34796930d45da65c93c90) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:24.119234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:24.120949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:24.127340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 96/191] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:23 2022] GET /identity/v3/role_assignments?user.id=2fb468f388b34796930d45da65c93c90&scope.project.id=8dffd45c43d84b93998a644084702e4e&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:24.128081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.172794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed366d6d-53d8-4a5a-84b6-49a4f48217c0 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.191349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:24.218169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f5e1-7d79-437b-8d22-1abb01a93d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.219063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f5e1-7d79-437b-8d22-1abb01a93d53 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.219444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f5e1-7d79-437b-8d22-1abb01a93d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.219816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6f5e1-7d79-437b-8d22-1abb01a93d53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.221168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6f5e1-7d79-437b-8d22-1abb01a93d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:24.223173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6f5e1-7d79-437b-8d22-1abb01a93d53 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:24.227823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 96/192] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:24.228811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f5e1-7d79-437b-8d22-1abb01a93d53 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.262900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f025bbb-b326-41e1-8b92-c0ecdab62893 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.293311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:24.316366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8de3d8-e332-4ae9-9bd0-60dee6a5ff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.317056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8de3d8-e332-4ae9-9bd0-60dee6a5ff48 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.317380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8de3d8-e332-4ae9-9bd0-60dee6a5ff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.317694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8de3d8-e332-4ae9-9bd0-60dee6a5ff48 None admin] PATH_INFO: `/v3/users/efd78a3fd8ce4026946f5e141997681d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.337259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8de3d8-e332-4ae9-9bd0-60dee6a5ff48 None admin] RBAC: Authorizing `identity:get_user(user_id=efd78a3fd8ce4026946f5e141997681d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:24.339019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8de3d8-e332-4ae9-9bd0-60dee6a5ff48 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:24.345549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 97/193] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/users/efd78a3fd8ce4026946f5e141997681d => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:24.345549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8de3d8-e332-4ae9-9bd0-60dee6a5ff48 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.365004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6f5e1-7d79-437b-8d22-1abb01a93d53 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.411823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.412470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.412755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.413029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.413753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:24.414064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:24.415455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:24.424243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 97/194] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:24.425182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.463380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8de3d8-e332-4ae9-9bd0-60dee6a5ff48 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.466021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:24.501571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69514c98-8b25-497a-bca1-52cc118c1952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.502121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69514c98-8b25-497a-bca1-52cc118c1952 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.502405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69514c98-8b25-497a-bca1-52cc118c1952 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.502678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69514c98-8b25-497a-bca1-52cc118c1952 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.503331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69514c98-8b25-497a-bca1-52cc118c1952 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:24.504907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69514c98-8b25-497a-bca1-52cc118c1952 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:24.525977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 98/195] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:24:24 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:24.525977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69514c98-8b25-497a-bca1-52cc118c1952 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.537833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ded84-963f-424d-ba6a-f817f2c6a946 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.543359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:24.573606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafba6e-8c59-4ae2-ae63-026ce1ec7f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.574263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafba6e-8c59-4ae2-ae63-026ce1ec7f1a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.574542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafba6e-8c59-4ae2-ae63-026ce1ec7f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.574989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafba6e-8c59-4ae2-ae63-026ce1ec7f1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.591285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafba6e-8c59-4ae2-ae63-026ce1ec7f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-baafba6e-8c59-4ae2-ae63-026ce1ec7f1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:24.598561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:24.600052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:24.600875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 98/196] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:24.602670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafba6e-8c59-4ae2-ae63-026ce1ec7f1a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.663141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69514c98-8b25-497a-bca1-52cc118c1952 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.712227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf1a3-ef1d-4cb6-b628-c1e67671b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.713237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf1a3-ef1d-4cb6-b628-c1e67671b622 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.713526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf1a3-ef1d-4cb6-b628-c1e67671b622 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.713824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf1a3-ef1d-4cb6-b628-c1e67671b622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.723721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafba6e-8c59-4ae2-ae63-026ce1ec7f1a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.750928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:24.768587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9eade-3583-4202-b115-aedd585a356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.771048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9eade-3583-4202-b115-aedd585a356b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.771048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9eade-3583-4202-b115-aedd585a356b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.771048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9eade-3583-4202-b115-aedd585a356b None admin] PATH_INFO: `/v3/users/efd78a3fd8ce4026946f5e141997681d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.772783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9eade-3583-4202-b115-aedd585a356b None admin] RBAC: Authorizing `identity:get_user(user_id=efd78a3fd8ce4026946f5e141997681d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:24.774124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9eade-3583-4202-b115-aedd585a356b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:24.775769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 99/197] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/users/efd78a3fd8ce4026946f5e141997681d => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:24.777581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9eade-3583-4202-b115-aedd585a356b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.816413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bf1a3-ef1d-4cb6-b628-c1e67671b622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:24.818499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bf1a3-ef1d-4cb6-b628-c1e67671b622 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:24.835270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:24.914309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9eade-3583-4202-b115-aedd585a356b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:24.955145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:24.955773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:24.956125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:24.956409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:24.957091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:24.957409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:24.959425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:24.965976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 99/198] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:24.972034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 100/199] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:24.972222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf1a3-ef1d-4cb6-b628-c1e67671b622 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:24.974423 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:25.056083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:25.118542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf1a3-ef1d-4cb6-b628-c1e67671b622 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:25.121388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:25.125636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33163b3a-4028-43a0-9e1b-c43f5e3ca7a3 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:25.176247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a82203-e89a-4f53-b7b9-7c584805b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:25.177481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a82203-e89a-4f53-b7b9-7c584805b39c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:25.177890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a82203-e89a-4f53-b7b9-7c584805b39c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:25.178223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a82203-e89a-4f53-b7b9-7c584805b39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:25.179939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba17bbf-0b7b-4c82-9e25-0f362607021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:25.181317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17bbf-0b7b-4c82-9e25-0f362607021d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:25.181827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17bbf-0b7b-4c82-9e25-0f362607021d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:25.182281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba17bbf-0b7b-4c82-9e25-0f362607021d None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:25.183859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba17bbf-0b7b-4c82-9e25-0f362607021d None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:25.185640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba17bbf-0b7b-4c82-9e25-0f362607021d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:25.187586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 101/200] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:25.188933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba17bbf-0b7b-4c82-9e25-0f362607021d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:25.268677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a82203-e89a-4f53-b7b9-7c584805b39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:25.270467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a82203-e89a-4f53-b7b9-7c584805b39c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:25.315271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba17bbf-0b7b-4c82-9e25-0f362607021d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:25.337231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:25.355913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516170e7-cd60-452d-8df0-0f987020daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:25.356894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516170e7-cd60-452d-8df0-0f987020daae None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:25.357315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516170e7-cd60-452d-8df0-0f987020daae None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:25.357829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516170e7-cd60-452d-8df0-0f987020daae None admin] PATH_INFO: `/v3/users/9309c1b0c7db43a08bfe3d8207db2bd7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:25.359274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516170e7-cd60-452d-8df0-0f987020daae None admin] RBAC: Authorizing `identity:get_user(user_id=9309c1b0c7db43a08bfe3d8207db2bd7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:25.361005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516170e7-cd60-452d-8df0-0f987020daae None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:25.362799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 102/201] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:25 2022] GET /identity/v3/users/9309c1b0c7db43a08bfe3d8207db2bd7 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:25.363715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516170e7-cd60-452d-8df0-0f987020daae None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:25.393422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 100/202] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:25.394555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a82203-e89a-4f53-b7b9-7c584805b39c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:25.412636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:25.501547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516170e7-cd60-452d-8df0-0f987020daae None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:25.533446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a82203-e89a-4f53-b7b9-7c584805b39c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:25.546535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:25.547159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:25.547445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:25.547726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:25.548931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=c37a56c851e44bbdae9b44a245897c27, user.id=efd78a3fd8ce4026946f5e141997681d) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:25.549252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:25.550905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:25.560925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 103/203] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:25 2022] GET /identity/v3/role_assignments?user.id=efd78a3fd8ce4026946f5e141997681d&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:25.561807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:25.586101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33dd7a-de59-4b7b-ad07-f2adc0c24bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:25.587148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33dd7a-de59-4b7b-ad07-f2adc0c24bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:25.587645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33dd7a-de59-4b7b-ad07-f2adc0c24bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:25.588252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33dd7a-de59-4b7b-ad07-f2adc0c24bd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:25.625536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:25.678175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:25.681766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4b423-4f9c-4067-8abf-104c07387a34 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:25.682158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33dd7a-de59-4b7b-ad07-f2adc0c24bd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:25.684990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33dd7a-de59-4b7b-ad07-f2adc0c24bd9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:25.736525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62250567-3a66-4259-bb2b-29acc59b9730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:25.737506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62250567-3a66-4259-bb2b-29acc59b9730 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:25.738722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62250567-3a66-4259-bb2b-29acc59b9730 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:25.739220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62250567-3a66-4259-bb2b-29acc59b9730 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:25.741094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62250567-3a66-4259-bb2b-29acc59b9730 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:25.743216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62250567-3a66-4259-bb2b-29acc59b9730 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:25.746230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 104/204] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:25 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:25.752358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62250567-3a66-4259-bb2b-29acc59b9730 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:25.882587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 101/205] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:25.889612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33dd7a-de59-4b7b-ad07-f2adc0c24bd9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:25.966304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62250567-3a66-4259-bb2b-29acc59b9730 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:26.006444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:26.007542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:26.008031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:26.008498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:26.009473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] RBAC: Adding query filter params (role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=c37a56c851e44bbdae9b44a245897c27, user.id=efd78a3fd8ce4026946f5e141997681d) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:26.010084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:26.011914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:26.018780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 105/206] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:25 2022] GET /identity/v3/role_assignments?user.id=efd78a3fd8ce4026946f5e141997681d&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=9d32107ec65445988af384e49812cfa7 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:26.034737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:26.103049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33dd7a-de59-4b7b-ad07-f2adc0c24bd9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:26.152106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c81d7-e65b-45bf-b630-a8a3316ea4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:26.152741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c81d7-e65b-45bf-b630-a8a3316ea4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:26.152952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c81d7-e65b-45bf-b630-a8a3316ea4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:26.153213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c81d7-e65b-45bf-b630-a8a3316ea4e7 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:26.158465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c81d7-e65b-45bf-b630-a8a3316ea4e7 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:26.159963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c81d7-e65b-45bf-b630-a8a3316ea4e7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:26.162176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 102/207] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:25 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:26.168117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:26.229006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:26.319775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a699a-0cd3-4609-8c2a-f912b327a3f2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:26.359089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f657ec-d6b9-4164-b796-b5533fa18f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:26.359721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f657ec-d6b9-4164-b796-b5533fa18f2d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:26.360005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f657ec-d6b9-4164-b796-b5533fa18f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:26.360282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f657ec-d6b9-4164-b796-b5533fa18f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:26.361024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f657ec-d6b9-4164-b796-b5533fa18f2d None admin] RBAC: Adding query filter params (role.id=4c92d05fadd144138dd605c7f197e36a, scope.project.id=159c16b029f94d2d8a928099d7e0ff73, user.id=9309c1b0c7db43a08bfe3d8207db2bd7) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:26.361340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f657ec-d6b9-4164-b796-b5533fa18f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:26.362844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f657ec-d6b9-4164-b796-b5533fa18f2d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:26.370060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 106/208] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:26 2022] GET /identity/v3/role_assignments?user.id=9309c1b0c7db43a08bfe3d8207db2bd7&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=4c92d05fadd144138dd605c7f197e36a => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:27.019923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8fdbd-54b5-4cc7-8bb6-cbdf5fbf3ded None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:27.020169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8fdbd-54b5-4cc7-8bb6-cbdf5fbf3ded None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:27.020454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8fdbd-54b5-4cc7-8bb6-cbdf5fbf3ded None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:27.022143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 103/209] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:27.027780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160329-1b7f-4cef-aee2-372c010f6171 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:27.028204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160329-1b7f-4cef-aee2-372c010f6171 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:27.028590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72160329-1b7f-4cef-aee2-372c010f6171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:27.049944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-72160329-1b7f-4cef-aee2-372c010f6171 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:27.051226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-72160329-1b7f-4cef-aee2-372c010f6171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:27.135297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 107/210] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:27.407195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8fdbd-54b5-4cc7-8bb6-cbdf5fbf3ded None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:27.408965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0cebc-bdaa-49e4-ac50-516ca6722dc8 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:27.409773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0cebc-bdaa-49e4-ac50-516ca6722dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:27.410350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0cebc-bdaa-49e4-ac50-516ca6722dc8 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:27.412628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 108/211] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:27.418363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1468-0f6d-436b-bee1-7aba6d0629bd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:27.418912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1468-0f6d-436b-bee1-7aba6d0629bd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:27.419521 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b1468-0f6d-436b-bee1-7aba6d0629bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:27.440318 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5b9b1468-0f6d-436b-bee1-7aba6d0629bd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:27.441756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5b9b1468-0f6d-436b-bee1-7aba6d0629bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:27.467649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:27.527501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8fdbd-54b5-4cc7-8bb6-cbdf5fbf3ded None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:27.534104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 109/212] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:27.564949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:27.573295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764000-2db6-4ad4-ac1c-e43948592a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:27.574016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764000-2db6-4ad4-ac1c-e43948592a67 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:27.574297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764000-2db6-4ad4-ac1c-e43948592a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:27.574625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764000-2db6-4ad4-ac1c-e43948592a67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:27.585817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24764000-2db6-4ad4-ac1c-e43948592a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-24764000-2db6-4ad4-ac1c-e43948592a67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:27.590986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:27.591849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:27.592630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 104/213] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:27.600094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1468-0f6d-436b-bee1-7aba6d0629bd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:27.715603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b1468-0f6d-436b-bee1-7aba6d0629bd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:27.751333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:27.751949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:27.752228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:27.752503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:27.753209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:27.753656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:27.755670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:27.765050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 110/214] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:27.771726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764000-2db6-4ad4-ac1c-e43948592a67 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:27.842609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:27.865128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:27.903941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764000-2db6-4ad4-ac1c-e43948592a67 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:27.950604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8c339-4df0-4146-a0e8-58ac5c6cef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:27.951592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8c339-4df0-4146-a0e8-58ac5c6cef33 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:27.952069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8c339-4df0-4146-a0e8-58ac5c6cef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:27.952564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8c339-4df0-4146-a0e8-58ac5c6cef33 None admin] PATH_INFO: `/v3/users/debdfc47dd8642e9aa802171edaf58b7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:27.971598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8c339-4df0-4146-a0e8-58ac5c6cef33 None admin] RBAC: Authorizing `identity:get_user(user_id=debdfc47dd8642e9aa802171edaf58b7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:27.973693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8c339-4df0-4146-a0e8-58ac5c6cef33 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:27.975930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 105/215] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:27 2022] GET /identity/v3/users/debdfc47dd8642e9aa802171edaf58b7 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:27.982197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8c339-4df0-4146-a0e8-58ac5c6cef33 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:27.998375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d05bc-9d8b-4ab4-b634-1555df9eef85 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:28.040726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:28.046077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc31208-d916-4414-8081-b9eff99f4830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:28.046718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc31208-d916-4414-8081-b9eff99f4830 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.047007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc31208-d916-4414-8081-b9eff99f4830 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.047311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc31208-d916-4414-8081-b9eff99f4830 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.048409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc31208-d916-4414-8081-b9eff99f4830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:28.049897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc31208-d916-4414-8081-b9eff99f4830 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:28.056821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 111/216] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:28.056821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79457266-c8ad-426b-a1b1-e5f3f316e528 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.056821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79457266-c8ad-426b-a1b1-e5f3f316e528 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.056821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79457266-c8ad-426b-a1b1-e5f3f316e528 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.056821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 112/217] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:28.059506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79457266-c8ad-426b-a1b1-e5f3f316e528 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:28.108849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8c339-4df0-4146-a0e8-58ac5c6cef33 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:28.147134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c493dee-ae2e-46df-881e-94c0afad9861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:28.147946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c493dee-ae2e-46df-881e-94c0afad9861 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.148227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c493dee-ae2e-46df-881e-94c0afad9861 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.148506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c493dee-ae2e-46df-881e-94c0afad9861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.169925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:28.191611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79457266-c8ad-426b-a1b1-e5f3f316e528 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:28.230501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e6a97-18ec-4f2f-864c-758ba30c3a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:28.231144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6a97-18ec-4f2f-864c-758ba30c3a71 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.231429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6a97-18ec-4f2f-864c-758ba30c3a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.231702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6a97-18ec-4f2f-864c-758ba30c3a71 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.232469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e6a97-18ec-4f2f-864c-758ba30c3a71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:28.233980 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e6a97-18ec-4f2f-864c-758ba30c3a71 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:28.248349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c493dee-ae2e-46df-881e-94c0afad9861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:28.249863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c493dee-ae2e-46df-881e-94c0afad9861 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:28.260051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 113/218] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:24:28 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:28.261611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db25ea-54dc-43de-8b78-2b76396e5853 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.262157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db25ea-54dc-43de-8b78-2b76396e5853 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.262610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db25ea-54dc-43de-8b78-2b76396e5853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.287662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-08db25ea-54dc-43de-8b78-2b76396e5853 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:28.288886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-08db25ea-54dc-43de-8b78-2b76396e5853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:28.319284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:28.386848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 114/219] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:28.407147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 106/220] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 12:24:28.415956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db25ea-54dc-43de-8b78-2b76396e5853 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:28.456798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3f7ea-f919-41d1-a25a-b52c9e121fd7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.457618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3f7ea-f919-41d1-a25a-b52c9e121fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.457618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3f7ea-f919-41d1-a25a-b52c9e121fd7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.459037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 107/221] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:28.465237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6bf7-15f2-423f-87ab-a61c059379c2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.465645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6bf7-15f2-423f-87ab-a61c059379c2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.465889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf6bf7-15f2-423f-87ab-a61c059379c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.487189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0dbf6bf7-15f2-423f-87ab-a61c059379c2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:28.489429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0dbf6bf7-15f2-423f-87ab-a61c059379c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:28.517303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:28.557015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db25ea-54dc-43de-8b78-2b76396e5853 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:28.585069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 108/222] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:28.602177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09a219-39dd-48af-980a-f126c0364984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:28.602820 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09a219-39dd-48af-980a-f126c0364984 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.603104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09a219-39dd-48af-980a-f126c0364984 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.603371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09a219-39dd-48af-980a-f126c0364984 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.604521 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09a219-39dd-48af-980a-f126c0364984 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:28.606041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09a219-39dd-48af-980a-f126c0364984 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:28.608021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 115/223] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:28 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:28.614788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf6bf7-15f2-423f-87ab-a61c059379c2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:28.665387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09a219-39dd-48af-980a-f126c0364984 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:28.712289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:28.744423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf6bf7-15f2-423f-87ab-a61c059379c2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:28.790271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:28.791649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.792211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.792729 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.794030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] RBAC: Adding query filter params (role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=c37a56c851e44bbdae9b44a245897c27, user.id=debdfc47dd8642e9aa802171edaf58b7) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:28.794522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:28.796868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:28.802703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09a219-39dd-48af-980a-f126c0364984 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:28.811199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 109/224] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:28 2022] GET /identity/v3/role_assignments?user.id=debdfc47dd8642e9aa802171edaf58b7&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:28.849007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b4f2d-9707-4f4e-8010-a46aea09a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:28.849955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b4f2d-9707-4f4e-8010-a46aea09a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:28.850332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b4f2d-9707-4f4e-8010-a46aea09a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:28.850705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b4f2d-9707-4f4e-8010-a46aea09a6b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:28.860789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:28.865218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b4f2d-9707-4f4e-8010-a46aea09a6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-fe1b4f2d-9707-4f4e-8010-a46aea09a6b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:28.871555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:28.872675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:28.873723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:28.876515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 116/225] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:28.882884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:28.889148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b4f2d-9707-4f4e-8010-a46aea09a6b5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:29.015924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e0b4a-0acc-4b2f-8601-b04b86c859fa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:29.056528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:29.057247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:29.057546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:29.057848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:29.058529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:29.058840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:29.059397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b4f2d-9707-4f4e-8010-a46aea09a6b5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:29.060243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:29.070175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 110/226] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:29.076813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:29.079908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:29.099380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc89842-5d3f-4cec-b194-984edc8b9f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:29.100264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89842-5d3f-4cec-b194-984edc8b9f21 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:29.100690 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89842-5d3f-4cec-b194-984edc8b9f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:29.101142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc89842-5d3f-4cec-b194-984edc8b9f21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:29.112743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc89842-5d3f-4cec-b194-984edc8b9f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-dcc89842-5d3f-4cec-b194-984edc8b9f21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:29.118833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:29.120194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:29.121097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:29.123239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 117/227] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:29.142331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc89842-5d3f-4cec-b194-984edc8b9f21 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:29.199099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5e5f2-ec76-4078-aec4-15a07069ff4a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:29.256189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153236ef-53f0-43b5-ae0e-1bc033e74c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:29.256845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153236ef-53f0-43b5-ae0e-1bc033e74c4d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:29.257127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153236ef-53f0-43b5-ae0e-1bc033e74c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:29.257406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153236ef-53f0-43b5-ae0e-1bc033e74c4d None admin] PATH_INFO: `/v3/users/efd78a3fd8ce4026946f5e141997681d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:29.260156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153236ef-53f0-43b5-ae0e-1bc033e74c4d None admin] RBAC: Authorizing `identity:get_user(user_id=efd78a3fd8ce4026946f5e141997681d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:29.261646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153236ef-53f0-43b5-ae0e-1bc033e74c4d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:29.272593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 111/228] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:29 2022] GET /identity/v3/users/efd78a3fd8ce4026946f5e141997681d => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:29.274216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153236ef-53f0-43b5-ae0e-1bc033e74c4d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:29.297949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:29.360044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc89842-5d3f-4cec-b194-984edc8b9f21 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:29.424488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:29.442828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:29.444133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:29.444615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:29.445109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:29.446029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:29.446534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:29.448144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:29.461765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 118/229] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:29.463452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153236ef-53f0-43b5-ae0e-1bc033e74c4d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:29.474426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:29.503772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a2a9-a790-44e0-a6da-5931f75e8a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:29.505113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a2a9-a790-44e0-a6da-5931f75e8a5e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:29.505403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a2a9-a790-44e0-a6da-5931f75e8a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:29.505710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a2a9-a790-44e0-a6da-5931f75e8a5e None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:29.506954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531a2a9-a790-44e0-a6da-5931f75e8a5e None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:29.508567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531a2a9-a790-44e0-a6da-5931f75e8a5e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:29.510657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 112/230] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:29 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:29.516462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a2a9-a790-44e0-a6da-5931f75e8a5e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:29.630198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a2a9-a790-44e0-a6da-5931f75e8a5e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:29.667283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354749-2239-44e7-ad7b-44c6efe6ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:29.667976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354749-2239-44e7-ad7b-44c6efe6ae26 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:29.668259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354749-2239-44e7-ad7b-44c6efe6ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:29.668586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29354749-2239-44e7-ad7b-44c6efe6ae26 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27/users/efd78a3fd8ce4026946f5e141997681d/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:29.670643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354749-2239-44e7-ad7b-44c6efe6ae26 None admin] RBAC: Authorizing `identity:create_grant(project_id=c37a56c851e44bbdae9b44a245897c27, user_id=efd78a3fd8ce4026946f5e141997681d, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:29.672105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29354749-2239-44e7-ad7b-44c6efe6ae26 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:29.681492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:29.703121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 113/231] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:29 2022] PUT /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27/users/efd78a3fd8ce4026946f5e141997681d/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:24:29.724345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f58f9a-263d-42bb-966a-05eb6e5d7a61 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:29.757730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:29.775419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaa55a-4345-46fd-957e-81377a0d10ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:29.776480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaa55a-4345-46fd-957e-81377a0d10ea None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:29.776967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaa55a-4345-46fd-957e-81377a0d10ea None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:29.777471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaa55a-4345-46fd-957e-81377a0d10ea None admin] PATH_INFO: `/v3/users/efd78a3fd8ce4026946f5e141997681d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:29.779122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaa55a-4345-46fd-957e-81377a0d10ea None admin] RBAC: Authorizing `identity:get_user(user_id=efd78a3fd8ce4026946f5e141997681d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:29.780832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaa55a-4345-46fd-957e-81377a0d10ea None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:29.783156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 119/232] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:29 2022] GET /identity/v3/users/efd78a3fd8ce4026946f5e141997681d => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:29.790677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354749-2239-44e7-ad7b-44c6efe6ae26 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:29.951726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29354749-2239-44e7-ad7b-44c6efe6ae26 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:30.008486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77aa1-da6c-4f1b-9a4d-6995d5306489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:30.009135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77aa1-da6c-4f1b-9a4d-6995d5306489 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:30.009414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77aa1-da6c-4f1b-9a4d-6995d5306489 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:30.009714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77aa1-da6c-4f1b-9a4d-6995d5306489 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:30.010860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac77aa1-da6c-4f1b-9a4d-6995d5306489 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:30.012314 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac77aa1-da6c-4f1b-9a4d-6995d5306489 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:30.014053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 114/233] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:29 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:30.019862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaa55a-4345-46fd-957e-81377a0d10ea None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:30.139116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaa55a-4345-46fd-957e-81377a0d10ea None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:30.187645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01408d-7ac6-479b-ad56-373466cf974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:30.188326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01408d-7ac6-479b-ad56-373466cf974e None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:30.188608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01408d-7ac6-479b-ad56-373466cf974e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:30.188885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01408d-7ac6-479b-ad56-373466cf974e None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27/users/efd78a3fd8ce4026946f5e141997681d/roles/9d32107ec65445988af384e49812cfa7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:30.191167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01408d-7ac6-479b-ad56-373466cf974e None admin] RBAC: Authorizing `identity:create_grant(project_id=c37a56c851e44bbdae9b44a245897c27, user_id=efd78a3fd8ce4026946f5e141997681d, role_id=9d32107ec65445988af384e49812cfa7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:30.192673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01408d-7ac6-479b-ad56-373466cf974e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:30.215533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 120/234] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:30 2022] PUT /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27/users/efd78a3fd8ce4026946f5e141997681d/roles/9d32107ec65445988af384e49812cfa7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:31.113936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699135e-758b-479e-8df7-9712af88c5f1 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:31.113936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699135e-758b-479e-8df7-9712af88c5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:31.113936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699135e-758b-479e-8df7-9712af88c5f1 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:31.115069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 115/235] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:31.122149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb86f-95b8-44bb-931f-f3680cca2aa7 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:31.122681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb86f-95b8-44bb-931f-f3680cca2aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:31.122681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cb86f-95b8-44bb-931f-f3680cca2aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:31.154739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-512cb86f-95b8-44bb-931f-f3680cca2aa7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:31.156003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-512cb86f-95b8-44bb-931f-f3680cca2aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:31.218889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:31.252291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 121/236] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:31.365176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fa37-e3a8-46d8-bf24-5719d1d059e8 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:31.365842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fa37-e3a8-46d8-bf24-5719d1d059e8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:31.366327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416fa37-e3a8-46d8-bf24-5719d1d059e8 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:31.367904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 116/237] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:31.383979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b778d-d320-41f3-a5af-432f71bc862d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:31.384308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b778d-d320-41f3-a5af-432f71bc862d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:31.384540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b778d-d320-41f3-a5af-432f71bc862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:31.418788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-038b778d-d320-41f3-a5af-432f71bc862d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:31.420024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-038b778d-d320-41f3-a5af-432f71bc862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:31.505258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 122/238] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:31.533347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06de1-462b-46b5-b149-d1fca253ec0e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:31.534024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06de1-462b-46b5-b149-d1fca253ec0e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:31.534535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06de1-462b-46b5-b149-d1fca253ec0e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:31.536261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 117/239] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:31.542669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef0ed-1c2f-47c8-8071-c96f4ddc1687 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:31.543016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef0ed-1c2f-47c8-8071-c96f4ddc1687 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:31.543303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ef0ed-1c2f-47c8-8071-c96f4ddc1687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:31.568656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-cc8ef0ed-1c2f-47c8-8071-c96f4ddc1687 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:31.569947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-cc8ef0ed-1c2f-47c8-8071-c96f4ddc1687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:31.658528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 123/240] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:31.693251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec06de1-462b-46b5-b149-d1fca253ec0e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:31.790073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:31.834279 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec06de1-462b-46b5-b149-d1fca253ec0e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:31.882197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ef0ed-1c2f-47c8-8071-c96f4ddc1687 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:31.882443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76828d19-2041-4c7c-8ae8-3c5104efb8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:31.882863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76828d19-2041-4c7c-8ae8-3c5104efb8ce None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:31.883210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76828d19-2041-4c7c-8ae8-3c5104efb8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:31.883497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76828d19-2041-4c7c-8ae8-3c5104efb8ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:31.906950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76828d19-2041-4c7c-8ae8-3c5104efb8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-76828d19-2041-4c7c-8ae8-3c5104efb8ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:31.913092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:31.914727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:31.917023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 118/241] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:31.922495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76828d19-2041-4c7c-8ae8-3c5104efb8ce None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:31.928222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:31.996793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ef0ed-1c2f-47c8-8071-c96f4ddc1687 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:32.037540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53410853-4d77-45d3-a357-070efc43116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:32.038567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53410853-4d77-45d3-a357-070efc43116a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:32.039265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53410853-4d77-45d3-a357-070efc43116a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:32.039692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53410853-4d77-45d3-a357-070efc43116a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:32.041381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53410853-4d77-45d3-a357-070efc43116a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:32.043039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53410853-4d77-45d3-a357-070efc43116a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:32.045058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 124/242] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:32.050693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53410853-4d77-45d3-a357-070efc43116a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:32.139467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76828d19-2041-4c7c-8ae8-3c5104efb8ce None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:32.199125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:32.217180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641fec3-893c-4358-90f9-802885404aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:32.218193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641fec3-893c-4358-90f9-802885404aed None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:32.218642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641fec3-893c-4358-90f9-802885404aed None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:32.219056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641fec3-893c-4358-90f9-802885404aed None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:32.219863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641fec3-893c-4358-90f9-802885404aed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:32.220305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641fec3-893c-4358-90f9-802885404aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:32.221986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641fec3-893c-4358-90f9-802885404aed None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:32.231488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 119/243] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:32.239624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53410853-4d77-45d3-a357-070efc43116a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:32.250120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:32.251941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641fec3-893c-4358-90f9-802885404aed None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:32.287710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf95445-bd5a-4106-9ca8-6bba42acb8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:32.288326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95445-bd5a-4106-9ca8-6bba42acb8d0 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:32.288607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95445-bd5a-4106-9ca8-6bba42acb8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:32.288883 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf95445-bd5a-4106-9ca8-6bba42acb8d0 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:32.289567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf95445-bd5a-4106-9ca8-6bba42acb8d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:32.291268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf95445-bd5a-4106-9ca8-6bba42acb8d0 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:32.317906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 125/244] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:24:32 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:24:32.319473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf95445-bd5a-4106-9ca8-6bba42acb8d0 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:32.448526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641fec3-893c-4358-90f9-802885404aed None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:32.512374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a457e-4e95-440f-9525-86c3afa99511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:32.513246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a457e-4e95-440f-9525-86c3afa99511 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:32.513718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a457e-4e95-440f-9525-86c3afa99511 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:32.516313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a457e-4e95-440f-9525-86c3afa99511 None admin] PATH_INFO: `/v3/users/2cd84c3d347748fa909122f37c385e10` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:32.517958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf95445-bd5a-4106-9ca8-6bba42acb8d0 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:32.533535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a457e-4e95-440f-9525-86c3afa99511 None admin] RBAC: Authorizing `identity:get_user(user_id=2cd84c3d347748fa909122f37c385e10)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:32.535554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a457e-4e95-440f-9525-86c3afa99511 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:32.537865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 120/245] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:32 2022] GET /identity/v3/users/2cd84c3d347748fa909122f37c385e10 => generated 297 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:32.543507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a457e-4e95-440f-9525-86c3afa99511 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:32.569776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95573ac9-fae8-49f2-a8a0-5b64bf42dfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:32.570704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573ac9-fae8-49f2-a8a0-5b64bf42dfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:32.571085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573ac9-fae8-49f2-a8a0-5b64bf42dfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:32.571455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95573ac9-fae8-49f2-a8a0-5b64bf42dfb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:32.585762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95573ac9-fae8-49f2-a8a0-5b64bf42dfb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-95573ac9-fae8-49f2-a8a0-5b64bf42dfb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:32.593571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:32.594504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:32.595299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 126/246] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:32.600971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95573ac9-fae8-49f2-a8a0-5b64bf42dfb4 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:32.606797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:32.649948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:32.691436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a457e-4e95-440f-9525-86c3afa99511 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:32.762316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc4af-0782-464d-a565-43bda6a3ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:32.765404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc4af-0782-464d-a565-43bda6a3ff9d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:32.767736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc4af-0782-464d-a565-43bda6a3ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:32.768026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc4af-0782-464d-a565-43bda6a3ff9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:32.771043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95573ac9-fae8-49f2-a8a0-5b64bf42dfb4 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:32.818758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409542d0-e33f-4a80-90b4-c6699a313b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:32.819379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409542d0-e33f-4a80-90b4-c6699a313b03 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:32.819663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409542d0-e33f-4a80-90b4-c6699a313b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:32.819938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409542d0-e33f-4a80-90b4-c6699a313b03 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:32.820616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409542d0-e33f-4a80-90b4-c6699a313b03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:32.820954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409542d0-e33f-4a80-90b4-c6699a313b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:32.822509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409542d0-e33f-4a80-90b4-c6699a313b03 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:32.831855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 127/247] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:32.833237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d555-27b3-4220-bf34-293c86f2b7f2 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:32.833551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d555-27b3-4220-bf34-293c86f2b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:32.833899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d555-27b3-4220-bf34-293c86f2b7f2 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:32.840762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 128/248] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:32.842634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2d555-27b3-4220-bf34-293c86f2b7f2 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:32.864076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dc4af-0782-464d-a565-43bda6a3ff9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:32.866375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dc4af-0782-464d-a565-43bda6a3ff9d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:32.934065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:32.969888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:32.985075 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2d555-27b3-4220-bf34-293c86f2b7f2 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:33.000881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 121/249] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:33.002187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be34ce-669a-412e-a00d-8b098c02862f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.002466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be34ce-669a-412e-a00d-8b098c02862f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.002738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be34ce-669a-412e-a00d-8b098c02862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.023403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a4be34ce-669a-412e-a00d-8b098c02862f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:33.024522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a4be34ce-669a-412e-a00d-8b098c02862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:33.028506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c2870-e26d-4589-b437-6ae1d29667e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:33.029764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c2870-e26d-4589-b437-6ae1d29667e2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.030251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c2870-e26d-4589-b437-6ae1d29667e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.030728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c2870-e26d-4589-b437-6ae1d29667e2 None admin] PATH_INFO: `/v3/users/debdfc47dd8642e9aa802171edaf58b7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.032447 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c2870-e26d-4589-b437-6ae1d29667e2 None admin] RBAC: Authorizing `identity:get_user(user_id=debdfc47dd8642e9aa802171edaf58b7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:33.034442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c2870-e26d-4589-b437-6ae1d29667e2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:33.037657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 129/250] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:32 2022] GET /identity/v3/users/debdfc47dd8642e9aa802171edaf58b7 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:33.038895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c2870-e26d-4589-b437-6ae1d29667e2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:33.114949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 122/251] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:33.115814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be34ce-669a-412e-a00d-8b098c02862f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:33.179762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c2870-e26d-4589-b437-6ae1d29667e2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:33.200550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:33.227057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be34ce-669a-412e-a00d-8b098c02862f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:33.247900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342590b-6c0a-4c21-8547-2a1141a04aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:33.249298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342590b-6c0a-4c21-8547-2a1141a04aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.249802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342590b-6c0a-4c21-8547-2a1141a04aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.250341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342590b-6c0a-4c21-8547-2a1141a04aa7 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.252864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342590b-6c0a-4c21-8547-2a1141a04aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:33.254788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342590b-6c0a-4c21-8547-2a1141a04aa7 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:33.256886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 130/252] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:33 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:33.263086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342590b-6c0a-4c21-8547-2a1141a04aa7 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:33.266074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d039a-57e6-4f23-909a-22112947fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:33.267787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d039a-57e6-4f23-909a-22112947fa05 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.268208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d039a-57e6-4f23-909a-22112947fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.268938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d039a-57e6-4f23-909a-22112947fa05 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.271561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d039a-57e6-4f23-909a-22112947fa05 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:33.275379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d039a-57e6-4f23-909a-22112947fa05 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:33.279772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 123/253] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:33 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:33.286727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d039a-57e6-4f23-909a-22112947fa05 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:33.320995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:33.419939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d039a-57e6-4f23-909a-22112947fa05 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:33.457929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856b76b-c750-4b2d-8dd3-8ef87c04e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:33.458899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b76b-c750-4b2d-8dd3-8ef87c04e781 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.459845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b76b-c750-4b2d-8dd3-8ef87c04e781 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.460289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856b76b-c750-4b2d-8dd3-8ef87c04e781 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27/users/debdfc47dd8642e9aa802171edaf58b7/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.462528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856b76b-c750-4b2d-8dd3-8ef87c04e781 None admin] RBAC: Authorizing `identity:create_grant(project_id=c37a56c851e44bbdae9b44a245897c27, user_id=debdfc47dd8642e9aa802171edaf58b7, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:33.464107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856b76b-c750-4b2d-8dd3-8ef87c04e781 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:33.484683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 124/254] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:33 2022] PUT /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27/users/debdfc47dd8642e9aa802171edaf58b7/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:33.488449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042491-f215-44fa-bd2c-00c041092265 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.488986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042491-f215-44fa-bd2c-00c041092265 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.489951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042491-f215-44fa-bd2c-00c041092265 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.491912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 125/255] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:33.492881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd042491-f215-44fa-bd2c-00c041092265 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:33.501625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:33.510956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342590b-6c0a-4c21-8547-2a1141a04aa7 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:33.557278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892e08e-e1e3-4569-857b-111679078b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:33.559251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e08e-e1e3-4569-857b-111679078b6c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.559725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e08e-e1e3-4569-857b-111679078b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.560205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e08e-e1e3-4569-857b-111679078b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.561994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e08e-e1e3-4569-857b-111679078b6c None admin] RBAC: Adding query filter params (role.id=4c92d05fadd144138dd605c7f197e36a, scope.project.id=c37a56c851e44bbdae9b44a245897c27, user.id=2cd84c3d347748fa909122f37c385e10) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:33.562582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e08e-e1e3-4569-857b-111679078b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:33.565148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e08e-e1e3-4569-857b-111679078b6c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:33.573540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 131/256] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:33 2022] GET /identity/v3/role_assignments?user.id=2cd84c3d347748fa909122f37c385e10&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=4c92d05fadd144138dd605c7f197e36a => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:33.575431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b08be-fe50-4715-8b11-94caab623aaa None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.576328 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b08be-fe50-4715-8b11-94caab623aaa None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.576760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b08be-fe50-4715-8b11-94caab623aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.609295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-633b08be-fe50-4715-8b11-94caab623aaa None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:33.610998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-633b08be-fe50-4715-8b11-94caab623aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:33.651679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd042491-f215-44fa-bd2c-00c041092265 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:33.745151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474880e8-7ffb-4ffd-a438-30e48e073b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:33.745835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474880e8-7ffb-4ffd-a438-30e48e073b53 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.746816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474880e8-7ffb-4ffd-a438-30e48e073b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.747093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474880e8-7ffb-4ffd-a438-30e48e073b53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.772784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 132/257] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:33.777391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474880e8-7ffb-4ffd-a438-30e48e073b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-474880e8-7ffb-4ffd-a438-30e48e073b53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:33.784745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:33.785762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:33.786548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:33.789277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 126/258] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:33.795245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b08be-fe50-4715-8b11-94caab623aaa None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:33.822994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:33.936040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b08be-fe50-4715-8b11-94caab623aaa None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:33.983924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:33.984553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:33.984829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:33.985102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:33.985800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:33.986106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:33.987526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:33.998219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 133/259] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:34.004509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474880e8-7ffb-4ffd-a438-30e48e073b53 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:34.081698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:34.102843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:34.170489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474880e8-7ffb-4ffd-a438-30e48e073b53 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:34.254545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507438-9b84-4a09-a4d9-90423cdef5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:34.256007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507438-9b84-4a09-a4d9-90423cdef5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:34.257372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507438-9b84-4a09-a4d9-90423cdef5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:34.259923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507438-9b84-4a09-a4d9-90423cdef5a3 None admin] PATH_INFO: `/v3/users/efd78a3fd8ce4026946f5e141997681d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:34.261353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507438-9b84-4a09-a4d9-90423cdef5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=efd78a3fd8ce4026946f5e141997681d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:34.263050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507438-9b84-4a09-a4d9-90423cdef5a3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:34.264863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:34.274836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 127/260] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:34 2022] GET /identity/v3/users/efd78a3fd8ce4026946f5e141997681d => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:34.277476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507438-9b84-4a09-a4d9-90423cdef5a3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:34.322643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdf8e0-e239-43c7-b46a-2c7c67ee67e1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:34.418267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4b71d-cc88-4837-b847-490eab6aded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:34.418899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b71d-cc88-4837-b847-490eab6aded2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:34.419178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b71d-cc88-4837-b847-490eab6aded2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:34.419452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4b71d-cc88-4837-b847-490eab6aded2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:34.438988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4b71d-cc88-4837-b847-490eab6aded2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-cae4b71d-cc88-4837-b847-490eab6aded2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:34.444461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:34.445373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:34.446192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:34.453952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 134/261] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:24:34.463772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507438-9b84-4a09-a4d9-90423cdef5a3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:34.467150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4b71d-cc88-4837-b847-490eab6aded2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:34.512530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:34.520668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f0b8e-e644-42b5-9068-8fb8aaf9b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:34.522211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f0b8e-e644-42b5-9068-8fb8aaf9b8fd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:34.522702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f0b8e-e644-42b5-9068-8fb8aaf9b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:34.523177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f0b8e-e644-42b5-9068-8fb8aaf9b8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:34.625471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f0b8e-e644-42b5-9068-8fb8aaf9b8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:34.627029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f0b8e-e644-42b5-9068-8fb8aaf9b8fd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:34.727721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4b71d-cc88-4837-b847-490eab6aded2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:34.772437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 128/262] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:34.777804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f0b8e-e644-42b5-9068-8fb8aaf9b8fd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:34.802213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:34.802836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:34.803113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:34.803386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:34.804055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:34.804358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:34.805920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:34.825963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:34.827403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 135/263] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:34.832432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:34.835123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:34.973457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f0b8e-e644-42b5-9068-8fb8aaf9b8fd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:35.054965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2184a5-a287-476b-b11a-3e08eab5d84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:35.056032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2184a5-a287-476b-b11a-3e08eab5d84d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:35.056517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2184a5-a287-476b-b11a-3e08eab5d84d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:35.056990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2184a5-a287-476b-b11a-3e08eab5d84d None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:35.058932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2184a5-a287-476b-b11a-3e08eab5d84d None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:35.060656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2184a5-a287-476b-b11a-3e08eab5d84d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:35.070116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 129/264] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:34 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:35.076434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2184a5-a287-476b-b11a-3e08eab5d84d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:35.095922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977c23-49bd-46a1-a5ed-04dd797a258b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:35.214310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52fab-60c9-4d50-8399-f0a43c09ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:35.214973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52fab-60c9-4d50-8399-f0a43c09ab35 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:35.215262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52fab-60c9-4d50-8399-f0a43c09ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:35.215542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52fab-60c9-4d50-8399-f0a43c09ab35 None admin] PATH_INFO: `/v3/users/efd78a3fd8ce4026946f5e141997681d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:35.216776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd52fab-60c9-4d50-8399-f0a43c09ab35 None admin] RBAC: Authorizing `identity:get_user(user_id=efd78a3fd8ce4026946f5e141997681d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:35.218276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd52fab-60c9-4d50-8399-f0a43c09ab35 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:35.220229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 136/265] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:34 2022] GET /identity/v3/users/efd78a3fd8ce4026946f5e141997681d => generated 283 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:35.225993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52fab-60c9-4d50-8399-f0a43c09ab35 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:35.297892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:35.302096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2184a5-a287-476b-b11a-3e08eab5d84d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:35.369644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:35.370285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:35.370551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:35.370827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:35.371555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=c37a56c851e44bbdae9b44a245897c27, user.id=efd78a3fd8ce4026946f5e141997681d) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:35.371865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:35.373322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:35.375549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:35.391878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 130/266] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:35 2022] GET /identity/v3/role_assignments?user.id=efd78a3fd8ce4026946f5e141997681d&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:35.429719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52fab-60c9-4d50-8399-f0a43c09ab35 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:35.486853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4beb8e-607e-4832-8023-f489d03008b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:35.487391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4beb8e-607e-4832-8023-f489d03008b2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:35.487672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4beb8e-607e-4832-8023-f489d03008b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:35.488582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4beb8e-607e-4832-8023-f489d03008b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:35.577368 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4beb8e-607e-4832-8023-f489d03008b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:35.578916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4beb8e-607e-4832-8023-f489d03008b2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:35.675967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:35.729504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 137/267] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:35.735698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:35.902627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80d3c-5178-41f1-8e53-03982c8f92a0 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:35.903273 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80d3c-5178-41f1-8e53-03982c8f92a0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:35.903868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80d3c-5178-41f1-8e53-03982c8f92a0 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:35.905266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ba069-6947-4709-8c3d-93477eaeba27 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:35.906035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 138/268] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:35.913295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d9f68-7893-4241-98be-62f2f4494d8f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:35.913991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d9f68-7893-4241-98be-62f2f4494d8f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:35.914488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d9f68-7893-4241-98be-62f2f4494d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:35.936195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-291d9f68-7893-4241-98be-62f2f4494d8f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:35.938667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-291d9f68-7893-4241-98be-62f2f4494d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:35.973166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b5a4b-0c2b-42da-80c9-b54782f25304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:35.974805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b5a4b-0c2b-42da-80c9-b54782f25304 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:35.974805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b5a4b-0c2b-42da-80c9-b54782f25304 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:35.974805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b5a4b-0c2b-42da-80c9-b54782f25304 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:35.979225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b5a4b-0c2b-42da-80c9-b54782f25304 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:35.980981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b5a4b-0c2b-42da-80c9-b54782f25304 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:35.983502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 131/269] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:35 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:35.984996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc767d-3eff-4fd0-a9f3-9e769312119d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:35.985495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc767d-3eff-4fd0-a9f3-9e769312119d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:35.986008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc767d-3eff-4fd0-a9f3-9e769312119d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:35.987741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 132/270] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:35.995263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc767d-3eff-4fd0-a9f3-9e769312119d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:36.044033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:36.047643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 139/271] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:36.053432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13296db1-8d7e-4cf5-b904-34b709b58bf3 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:36.053432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13296db1-8d7e-4cf5-b904-34b709b58bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:36.053432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13296db1-8d7e-4cf5-b904-34b709b58bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:36.074541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-13296db1-8d7e-4cf5-b904-34b709b58bf3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:36.075980 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-13296db1-8d7e-4cf5-b904-34b709b58bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:36.137124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc767d-3eff-4fd0-a9f3-9e769312119d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:36.179327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:36.180369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:36.180852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:36.181344 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:36.182312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] RBAC: Adding query filter params (role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=c37a56c851e44bbdae9b44a245897c27, user.id=efd78a3fd8ce4026946f5e141997681d) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:36.182868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:36.184502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:36.191872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 133/272] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:35 2022] GET /identity/v3/role_assignments?user.id=efd78a3fd8ce4026946f5e141997681d&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=9d32107ec65445988af384e49812cfa7 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:36.217681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 140/273] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:36.467081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:36.544607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13296db1-8d7e-4cf5-b904-34b709b58bf3 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:36.581388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:36.589649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:36.589835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615383b-76d9-4016-b7e8-8479aa33553c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:36.636920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccec1e3-aa96-4594-af57-a56ebcb9fcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:36.638244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec1e3-aa96-4594-af57-a56ebcb9fcdb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:36.638244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec1e3-aa96-4594-af57-a56ebcb9fcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:36.638244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec1e3-aa96-4594-af57-a56ebcb9fcdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:36.650746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccec1e3-aa96-4594-af57-a56ebcb9fcdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6ccec1e3-aa96-4594-af57-a56ebcb9fcdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:36.656397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:36.657292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:36.658114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 134/274] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:36.663969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99efe1-096a-4ed3-9a18-53f50c7ac193 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:36.664570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99efe1-096a-4ed3-9a18-53f50c7ac193 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:36.664854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99efe1-096a-4ed3-9a18-53f50c7ac193 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:36.666532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 135/275] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:36.667132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99efe1-096a-4ed3-9a18-53f50c7ac193 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:36.694454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13296db1-8d7e-4cf5-b904-34b709b58bf3 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:36.734217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74330a1a-59e4-461a-8900-b74fb8ce286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:36.734866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330a1a-59e4-461a-8900-b74fb8ce286c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:36.735209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330a1a-59e4-461a-8900-b74fb8ce286c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:36.735558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74330a1a-59e4-461a-8900-b74fb8ce286c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:36.736759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74330a1a-59e4-461a-8900-b74fb8ce286c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:36.738281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74330a1a-59e4-461a-8900-b74fb8ce286c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:36.739960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 141/276] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:36.741263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b46ec-2428-4a81-b5a7-11a151c7c7b9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:36.741972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b46ec-2428-4a81-b5a7-11a151c7c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:36.741972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b46ec-2428-4a81-b5a7-11a151c7c7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:36.762191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-130b46ec-2428-4a81-b5a7-11a151c7c7b9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:36.763433 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-130b46ec-2428-4a81-b5a7-11a151c7c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:36.792781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99efe1-096a-4ed3-9a18-53f50c7ac193 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:36.829843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:36.830831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:36.831269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:36.832215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:36.833032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:36.833485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:36.835061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:36.844461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 142/277] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:36.845302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b46ec-2428-4a81-b5a7-11a151c7c7b9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:36.845959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 136/278] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:36.854679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:36.877787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:36.880797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:36.967670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b46ec-2428-4a81-b5a7-11a151c7c7b9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:36.968374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce51768-5ddb-4935-983b-c2f40ea4e00a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:37.010090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdcb11-db78-4d00-a5d0-cb174e177bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:37.010622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdcb11-db78-4d00-a5d0-cb174e177bb1 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.010905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdcb11-db78-4d00-a5d0-cb174e177bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.011177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdcb11-db78-4d00-a5d0-cb174e177bb1 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.011835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdcb11-db78-4d00-a5d0-cb174e177bb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:37.012035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b266b-d125-4bb8-bde0-82e558675cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:37.012630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b266b-d125-4bb8-bde0-82e558675cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.012908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b266b-d125-4bb8-bde0-82e558675cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.013179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b266b-d125-4bb8-bde0-82e558675cc9 None admin] PATH_INFO: `/v3/users/673d844549ab4c45976317a0785ee2f7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.013329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdcb11-db78-4d00-a5d0-cb174e177bb1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:37.030256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b266b-d125-4bb8-bde0-82e558675cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=673d844549ab4c45976317a0785ee2f7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:37.031847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b266b-d125-4bb8-bde0-82e558675cc9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:37.033497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 137/279] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:36 2022] GET /identity/v3/users/673d844549ab4c45976317a0785ee2f7 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:37.034737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4d81b-f19c-4adc-b712-f8ec10aece35 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.035018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4d81b-f19c-4adc-b712-f8ec10aece35 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.035382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4d81b-f19c-4adc-b712-f8ec10aece35 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.036837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 138/280] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:37.041445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 143/281] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:24:36 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:37.042010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf94cc7-feb1-4368-bb80-6bc41e56a4e8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.042292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf94cc7-feb1-4368-bb80-6bc41e56a4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.042562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf94cc7-feb1-4368-bb80-6bc41e56a4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.043083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdcb11-db78-4d00-a5d0-cb174e177bb1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:37.064302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cbf94cc7-feb1-4368-bb80-6bc41e56a4e8 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:37.065718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cbf94cc7-feb1-4368-bb80-6bc41e56a4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:37.157600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 139/282] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:37.158815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf94cc7-feb1-4368-bb80-6bc41e56a4e8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:37.170232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:37.173565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:37.199963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdcb11-db78-4d00-a5d0-cb174e177bb1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:37.242302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:37.243215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.243963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.244231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.244996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] RBAC: Adding query filter params (role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, user.id=673d844549ab4c45976317a0785ee2f7, scope.system=all) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:37.245306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:37.246806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:37.252312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 144/283] 10.222.0.17 () {56 vars in 1308 bytes} [Mon Oct 3 12:24:37 2022] GET /identity/v3/role_assignments?user.id=673d844549ab4c45976317a0785ee2f7&scope.system=all&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:37.305817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf94cc7-feb1-4368-bb80-6bc41e56a4e8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:37.351777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235235c-f6cc-463a-81a9-32b2528b848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:37.352872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235235c-f6cc-463a-81a9-32b2528b848f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.353374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235235c-f6cc-463a-81a9-32b2528b848f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.353718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235235c-f6cc-463a-81a9-32b2528b848f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.366813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235235c-f6cc-463a-81a9-32b2528b848f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8235235c-f6cc-463a-81a9-32b2528b848f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:37.372698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:37.373658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:37.374459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 140/284] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:37.380359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:37.433868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235235c-f6cc-463a-81a9-32b2528b848f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:37.516661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af26c8-5e0e-4338-9055-bae1d6d1c7b5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:37.537905 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:37.557959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:37.558794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.559220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.559636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.560676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:37.561159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:37.563609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:37.581572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 145/285] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:37.586615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:37.591813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235235c-f6cc-463a-81a9-32b2528b848f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:37.603474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:37.641660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb50a5-8967-4cdd-a6d1-95f6bc6aa2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:37.643565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb50a5-8967-4cdd-a6d1-95f6bc6aa2bb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.644126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb50a5-8967-4cdd-a6d1-95f6bc6aa2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.645123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb50a5-8967-4cdd-a6d1-95f6bc6aa2bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.660467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb50a5-8967-4cdd-a6d1-95f6bc6aa2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8cfb50a5-8967-4cdd-a6d1-95f6bc6aa2bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:37.666004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:37.666925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:37.667712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:37.670465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 141/286] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:37.680474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb50a5-8967-4cdd-a6d1-95f6bc6aa2bb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:37.779875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e30387-8dd6-479e-b0d5-259ef4bf3e41 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:37.815198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb50a5-8967-4cdd-a6d1-95f6bc6aa2bb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:37.845003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:37.854905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f2415-8a37-4d72-893a-0bb4acf59918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:37.855567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f2415-8a37-4d72-893a-0bb4acf59918 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.855854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f2415-8a37-4d72-893a-0bb4acf59918 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.856131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f2415-8a37-4d72-893a-0bb4acf59918 None admin] PATH_INFO: `/v3/users/debdfc47dd8642e9aa802171edaf58b7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.858323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f2415-8a37-4d72-893a-0bb4acf59918 None admin] RBAC: Authorizing `identity:get_user(user_id=debdfc47dd8642e9aa802171edaf58b7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:37.859801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f2415-8a37-4d72-893a-0bb4acf59918 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:37.861639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 146/287] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:37 2022] GET /identity/v3/users/debdfc47dd8642e9aa802171edaf58b7 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:37.867159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:37.868422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f2415-8a37-4d72-893a-0bb4acf59918 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:37.869546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:37.869835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:37.870116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:37.870824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:37.871137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:37.872576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:37.890073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 142/288] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:37.896070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:38.009322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:38.061937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f2415-8a37-4d72-893a-0bb4acf59918 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:38.093414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab0421-c016-41b7-ae1b-638f928fbaa4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:38.123899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71f580-ce8f-439d-88c8-f2e890ec4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:38.124522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f580-ce8f-439d-88c8-f2e890ec4fdc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:38.124806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f580-ce8f-439d-88c8-f2e890ec4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:38.125087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71f580-ce8f-439d-88c8-f2e890ec4fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:38.161882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e194f-7c54-4eb1-9347-109fb3152570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:38.162533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e194f-7c54-4eb1-9347-109fb3152570 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:38.162813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e194f-7c54-4eb1-9347-109fb3152570 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:38.163150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e194f-7c54-4eb1-9347-109fb3152570 None admin] PATH_INFO: `/v3/users/2cd84c3d347748fa909122f37c385e10` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:38.164647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e194f-7c54-4eb1-9347-109fb3152570 None admin] RBAC: Authorizing `identity:get_user(user_id=2cd84c3d347748fa909122f37c385e10)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:38.166143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e194f-7c54-4eb1-9347-109fb3152570 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:38.169596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 143/289] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:37 2022] GET /identity/v3/users/2cd84c3d347748fa909122f37c385e10 => generated 297 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:38.175228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e194f-7c54-4eb1-9347-109fb3152570 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:38.266201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71f580-ce8f-439d-88c8-f2e890ec4fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:38.267696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71f580-ce8f-439d-88c8-f2e890ec4fdc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:38.277877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:38.342006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e194f-7c54-4eb1-9347-109fb3152570 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:38.385204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b9595-9967-49bb-b5ac-1dcc40612ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:38.385898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b9595-9967-49bb-b5ac-1dcc40612ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:38.386183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b9595-9967-49bb-b5ac-1dcc40612ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:38.386462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b9595-9967-49bb-b5ac-1dcc40612ac8 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:38.387872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b9595-9967-49bb-b5ac-1dcc40612ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:38.389105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b9595-9967-49bb-b5ac-1dcc40612ac8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:38.397683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 144/290] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:38 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:38.397683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b9595-9967-49bb-b5ac-1dcc40612ac8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:38.449877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:38.499909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 147/291] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:38.505162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71f580-ce8f-439d-88c8-f2e890ec4fdc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:38.511443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b9595-9967-49bb-b5ac-1dcc40612ac8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:38.542437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:38.557488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c555fba-0ae8-44ab-be84-1567735c59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:38.558472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555fba-0ae8-44ab-be84-1567735c59c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:38.558884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555fba-0ae8-44ab-be84-1567735c59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:38.559290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c555fba-0ae8-44ab-be84-1567735c59c8 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27/users/2cd84c3d347748fa909122f37c385e10/roles/4c92d05fadd144138dd605c7f197e36a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:38.561628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c555fba-0ae8-44ab-be84-1567735c59c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c37a56c851e44bbdae9b44a245897c27, user_id=2cd84c3d347748fa909122f37c385e10, role_id=4c92d05fadd144138dd605c7f197e36a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:38.563474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c555fba-0ae8-44ab-be84-1567735c59c8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:38.594579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 145/292] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:24:38 2022] PUT /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27/users/2cd84c3d347748fa909122f37c385e10/roles/4c92d05fadd144138dd605c7f197e36a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:24:38.731995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71f580-ce8f-439d-88c8-f2e890ec4fdc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:38.791214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f646a-f04f-409d-9878-70d7a35c6cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:38.791886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f646a-f04f-409d-9878-70d7a35c6cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:38.792170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f646a-f04f-409d-9878-70d7a35c6cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:38.792477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f646a-f04f-409d-9878-70d7a35c6cb7 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:38.793720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f646a-f04f-409d-9878-70d7a35c6cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:38.795243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f646a-f04f-409d-9878-70d7a35c6cb7 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:38.797229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 148/293] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:38 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:38.803489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c555fba-0ae8-44ab-be84-1567735c59c8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:38.962559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c555fba-0ae8-44ab-be84-1567735c59c8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:39.012979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285748bb-d826-44be-82b4-231005850382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:39.014012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285748bb-d826-44be-82b4-231005850382 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:39.014498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285748bb-d826-44be-82b4-231005850382 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:39.014974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285748bb-d826-44be-82b4-231005850382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:39.015905 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285748bb-d826-44be-82b4-231005850382 None admin] RBAC: Adding query filter params (role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=c37a56c851e44bbdae9b44a245897c27, user.id=debdfc47dd8642e9aa802171edaf58b7) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:39.016441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285748bb-d826-44be-82b4-231005850382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:39.018123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285748bb-d826-44be-82b4-231005850382 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:39.030645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 146/294] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:38 2022] GET /identity/v3/role_assignments?user.id=debdfc47dd8642e9aa802171edaf58b7&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:39.776639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247b60-3a43-489a-9384-c4106ce06c1e None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:39.777585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247b60-3a43-489a-9384-c4106ce06c1e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:39.778010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56247b60-3a43-489a-9384-c4106ce06c1e None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:39.779797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 149/295] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:39.785695 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5ea1-667e-4828-856b-70e1379ba0ce None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:39.786598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5ea1-667e-4828-856b-70e1379ba0ce None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:39.787088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec5ea1-667e-4828-856b-70e1379ba0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:39.814627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6bec5ea1-667e-4828-856b-70e1379ba0ce None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:39.815904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6bec5ea1-667e-4828-856b-70e1379ba0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:39.863213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:39.883459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95053-0b35-4ab0-9499-899e4c730ac4 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:39.884086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95053-0b35-4ab0-9499-899e4c730ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:39.884591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e95053-0b35-4ab0-9499-899e4c730ac4 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:39.886511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 150/296] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:39.890883 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 147/297] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:39.892679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117861b-c9b8-4af1-9a22-7bdba1d92e39 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:39.893179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117861b-c9b8-4af1-9a22-7bdba1d92e39 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:39.893713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117861b-c9b8-4af1-9a22-7bdba1d92e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:39.913647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b117861b-c9b8-4af1-9a22-7bdba1d92e39 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:39.915177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b117861b-c9b8-4af1-9a22-7bdba1d92e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:39.962480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:39.992321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 151/298] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:40.168580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec5ea1-667e-4828-856b-70e1379ba0ce None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.212198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefe2b4-1848-4376-9a1b-918c7990ab8e None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.212737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefe2b4-1848-4376-9a1b-918c7990ab8e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.213176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefe2b4-1848-4376-9a1b-918c7990ab8e None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.215756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 152/299] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:40.221467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cf60-94c4-4d34-9cd2-c5280a6dc213 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.222628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cf60-94c4-4d34-9cd2-c5280a6dc213 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.223104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3cf60-94c4-4d34-9cd2-c5280a6dc213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.243641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-68d3cf60-94c4-4d34-9cd2-c5280a6dc213 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:40.245150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-68d3cf60-94c4-4d34-9cd2-c5280a6dc213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:40.277798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec5ea1-667e-4828-856b-70e1379ba0ce None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:40.313753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb2e5a-d7c8-4cf0-8a2b-e008c51e1e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:40.314402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb2e5a-d7c8-4cf0-8a2b-e008c51e1e39 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.314685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb2e5a-d7c8-4cf0-8a2b-e008c51e1e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.314962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb2e5a-d7c8-4cf0-8a2b-e008c51e1e39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.324811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 153/300] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:40.329871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3cf60-94c4-4d34-9cd2-c5280a6dc213 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.330969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb2e5a-d7c8-4cf0-8a2b-e008c51e1e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-68cb2e5a-d7c8-4cf0-8a2b-e008c51e1e39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:40.338400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:40.339839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:40.340925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:40.343216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 148/301] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:40.350034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb2e5a-d7c8-4cf0-8a2b-e008c51e1e39 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.401838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:40.468034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3cf60-94c4-4d34-9cd2-c5280a6dc213 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:40.471127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:40.480013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb2e5a-d7c8-4cf0-8a2b-e008c51e1e39 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:40.516658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2b8e-8592-4af5-b8e3-39d040ee3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:40.517296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2b8e-8592-4af5-b8e3-39d040ee3392 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.517597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2b8e-8592-4af5-b8e3-39d040ee3392 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.517869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2b8e-8592-4af5-b8e3-39d040ee3392 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.531133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c2b8e-8592-4af5-b8e3-39d040ee3392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-888c2b8e-8592-4af5-b8e3-39d040ee3392 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:40.536214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:40.537094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:40.537898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:40.538497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:40.539865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.540399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.540776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 154/302] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:40.541891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.542745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:40.543207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:40.544745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:40.552120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2b8e-8592-4af5-b8e3-39d040ee3392 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.559265 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 149/303] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:40.560387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.672016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2b8e-8592-4af5-b8e3-39d040ee3392 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:40.694723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:40.700081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcdbe1c-4c73-4554-8ded-deb04e525b62 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:40.719664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:40.720295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.720640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.721089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.721818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:40.722134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:40.723509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:40.733567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 155/304] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:40.733567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.747173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbb7c5-1dfa-4b59-a5d4-77824f65d382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:40.747899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbb7c5-1dfa-4b59-a5d4-77824f65d382 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.748254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbb7c5-1dfa-4b59-a5d4-77824f65d382 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.748540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbb7c5-1dfa-4b59-a5d4-77824f65d382 None admin] PATH_INFO: `/v3/users/673d844549ab4c45976317a0785ee2f7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.749996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbb7c5-1dfa-4b59-a5d4-77824f65d382 None admin] RBAC: Authorizing `identity:get_user(user_id=673d844549ab4c45976317a0785ee2f7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:40.751438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbb7c5-1dfa-4b59-a5d4-77824f65d382 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:40.753873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 150/305] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:40 2022] GET /identity/v3/users/673d844549ab4c45976317a0785ee2f7 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:40.754843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbb7c5-1dfa-4b59-a5d4-77824f65d382 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.772088 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:40.853700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c561bfe-435d-4112-a52a-5c1a34e3b85b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:40.887584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbb7c5-1dfa-4b59-a5d4-77824f65d382 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:40.908267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af195-04ce-4171-aa08-3553e09f8266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:40.909229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af195-04ce-4171-aa08-3553e09f8266 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.909503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af195-04ce-4171-aa08-3553e09f8266 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.910088 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af195-04ce-4171-aa08-3553e09f8266 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.911389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842af195-04ce-4171-aa08-3553e09f8266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:40.913472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842af195-04ce-4171-aa08-3553e09f8266 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:40.917559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 156/306] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:40.917559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af195-04ce-4171-aa08-3553e09f8266 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.921094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a71b-a249-4066-b147-3d65c38285f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:40.921785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a71b-a249-4066-b147-3d65c38285f8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:40.922064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a71b-a249-4066-b147-3d65c38285f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:40.922348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a71b-a249-4066-b147-3d65c38285f8 None admin] PATH_INFO: `/v3/users/0504174b52f846d5855d4f8e00167334` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:40.936764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7a71b-a249-4066-b147-3d65c38285f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0504174b52f846d5855d4f8e00167334)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:40.938274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7a71b-a249-4066-b147-3d65c38285f8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:40.939953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 151/307] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:40 2022] GET /identity/v3/users/0504174b52f846d5855d4f8e00167334 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:40.941324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a71b-a249-4066-b147-3d65c38285f8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:40.974449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:41.032058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:41.039425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af195-04ce-4171-aa08-3553e09f8266 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:41.055184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a71b-a249-4066-b147-3d65c38285f8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:41.073793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1035-8a10-4b06-a13d-36e00d3c430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:41.074440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1035-8a10-4b06-a13d-36e00d3c430a None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:41.074720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1035-8a10-4b06-a13d-36e00d3c430a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:41.075004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe1035-8a10-4b06-a13d-36e00d3c430a None admin] PATH_INFO: `/v3/system/users/673d844549ab4c45976317a0785ee2f7/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:41.076407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe1035-8a10-4b06-a13d-36e00d3c430a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=673d844549ab4c45976317a0785ee2f7, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:41.077863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe1035-8a10-4b06-a13d-36e00d3c430a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:41.087041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 157/308] 10.222.0.17 () {58 vars in 1334 bytes} [Mon Oct 3 12:24:40 2022] PUT /identity/v3/system/users/673d844549ab4c45976317a0785ee2f7/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:41.087985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1035-8a10-4b06-a13d-36e00d3c430a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:41.090247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac47a5-7f74-4d5c-b272-a996e6dc78e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:41.090870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac47a5-7f74-4d5c-b272-a996e6dc78e8 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:41.091173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac47a5-7f74-4d5c-b272-a996e6dc78e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:41.091459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac47a5-7f74-4d5c-b272-a996e6dc78e8 None admin] PATH_INFO: `/v3/groups` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:41.092231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac47a5-7f74-4d5c-b272-a996e6dc78e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:41.093770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac47a5-7f74-4d5c-b272-a996e6dc78e8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:41.113801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 152/309] 10.222.0.17 () {60 vars in 1134 bytes} [Mon Oct 3 12:24:40 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:24:41.114970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63ff9-9675-4c99-81c9-864856feb87c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:41.115262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63ff9-9675-4c99-81c9-864856feb87c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:41.115542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf63ff9-9675-4c99-81c9-864856feb87c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:41.116766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 153/310] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:41.131085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61565-4e84-46ce-8f34-a1f4a08d436c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:41.131404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61565-4e84-46ce-8f34-a1f4a08d436c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:41.131636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61565-4e84-46ce-8f34-a1f4a08d436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:41.160559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0ff61565-4e84-46ce-8f34-a1f4a08d436c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:41.161901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0ff61565-4e84-46ce-8f34-a1f4a08d436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:41.243922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe1035-8a10-4b06-a13d-36e00d3c430a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:41.251812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 154/311] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:41.292447 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:41.293158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:41.293435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:41.293742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:41.294493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] RBAC: Adding query filter params (role.id=4c92d05fadd144138dd605c7f197e36a, user.id=0504174b52f846d5855d4f8e00167334, scope.system=all) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:41.294804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:41.296284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:41.303048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 158/312] 10.222.0.17 () {56 vars in 1308 bytes} [Mon Oct 3 12:24:41 2022] GET /identity/v3/role_assignments?user.id=0504174b52f846d5855d4f8e00167334&scope.system=all&role.id=4c92d05fadd144138dd605c7f197e36a => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:41.527492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61565-4e84-46ce-8f34-a1f4a08d436c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:41.546326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:41.644671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61565-4e84-46ce-8f34-a1f4a08d436c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:41.692607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b809aa6-426a-4940-93c2-94d4cd01d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:41.693399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809aa6-426a-4940-93c2-94d4cd01d955 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:41.697540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809aa6-426a-4940-93c2-94d4cd01d955 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:41.697540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b809aa6-426a-4940-93c2-94d4cd01d955 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:41.705630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b809aa6-426a-4940-93c2-94d4cd01d955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0b809aa6-426a-4940-93c2-94d4cd01d955 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:41.711036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:41.711958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:41.712748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 155/313] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:41.718138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:41.746498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:41.842659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dc289-9d83-49b4-8efc-1b8a87cd9379 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:41.879817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:41.880477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:41.880699 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:41.880967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:41.881658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:41.881962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:41.883352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:41.894167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 159/314] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:41.899586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b809aa6-426a-4940-93c2-94d4cd01d955 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:41.988134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:42.013129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b809aa6-426a-4940-93c2-94d4cd01d955 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:42.050475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0f619-e831-4717-a128-db954bbd611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:42.051111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f619-e831-4717-a128-db954bbd611c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:42.051388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f619-e831-4717-a128-db954bbd611c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:42.051659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f619-e831-4717-a128-db954bbd611c None admin] PATH_INFO: `/v3/users/2cd84c3d347748fa909122f37c385e10` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:42.052788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0f619-e831-4717-a128-db954bbd611c None admin] RBAC: Authorizing `identity:get_user(user_id=2cd84c3d347748fa909122f37c385e10)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:42.054299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0f619-e831-4717-a128-db954bbd611c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:42.055886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 156/315] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:41 2022] GET /identity/v3/users/2cd84c3d347748fa909122f37c385e10 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:42.061599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:42.160713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:42.179297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e17dbe-7788-4ee7-9a13-9842c3a5ee01 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:42.215486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e9507-b31e-4176-be96-94956dce6a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:42.216099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9507-b31e-4176-be96-94956dce6a8a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:42.216381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9507-b31e-4176-be96-94956dce6a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:42.216654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e9507-b31e-4176-be96-94956dce6a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:42.294474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e9507-b31e-4176-be96-94956dce6a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:42.296052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e9507-b31e-4176-be96-94956dce6a8a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:42.381129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:42.398655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 160/316] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:42.406634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0f619-e831-4717-a128-db954bbd611c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:42.518792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0f619-e831-4717-a128-db954bbd611c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:42.559151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fb7e8-9576-4d2c-95eb-ecf5e923d435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:42.559801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb7e8-9576-4d2c-95eb-ecf5e923d435 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:42.560081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb7e8-9576-4d2c-95eb-ecf5e923d435 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:42.560357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fb7e8-9576-4d2c-95eb-ecf5e923d435 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:42.561491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fb7e8-9576-4d2c-95eb-ecf5e923d435 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:42.562947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fb7e8-9576-4d2c-95eb-ecf5e923d435 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:42.564983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 157/317] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:42 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:42.571276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e9507-b31e-4176-be96-94956dce6a8a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:42.678255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e9507-b31e-4176-be96-94956dce6a8a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:42.720361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87395a99-0060-46de-85c5-d750e1662f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:42.720979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395a99-0060-46de-85c5-d750e1662f37 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:42.721259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395a99-0060-46de-85c5-d750e1662f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:42.721551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87395a99-0060-46de-85c5-d750e1662f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:42.722797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87395a99-0060-46de-85c5-d750e1662f37 None admin] RBAC: Adding query filter params (role.id=4c92d05fadd144138dd605c7f197e36a, scope.project.id=c37a56c851e44bbdae9b44a245897c27, user.id=2cd84c3d347748fa909122f37c385e10) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:42.723112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87395a99-0060-46de-85c5-d750e1662f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:42.724559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87395a99-0060-46de-85c5-d750e1662f37 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:42.731196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 161/318] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:24:42 2022] GET /identity/v3/role_assignments?user.id=2cd84c3d347748fa909122f37c385e10&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=4c92d05fadd144138dd605c7f197e36a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:43.419838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4007fe-8a45-4149-be5d-b50444f91a75 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:43.420362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4007fe-8a45-4149-be5d-b50444f91a75 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:43.420362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4007fe-8a45-4149-be5d-b50444f91a75 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:43.422001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 158/319] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:43.427180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eca1f0-122e-4d0a-b7bd-cb9dd576597b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:43.427678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eca1f0-122e-4d0a-b7bd-cb9dd576597b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:43.427763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eca1f0-122e-4d0a-b7bd-cb9dd576597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:43.446158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e7eca1f0-122e-4d0a-b7bd-cb9dd576597b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:43.447352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e7eca1f0-122e-4d0a-b7bd-cb9dd576597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:43.451562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc572b37-ef7f-4628-8c24-e607c01bceda None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:43.451851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc572b37-ef7f-4628-8c24-e607c01bceda None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:43.452132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc572b37-ef7f-4628-8c24-e607c01bceda None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:43.453634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 159/320] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:24:43.459305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a12355-976c-4e1c-94dd-92e9ffaae26f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:43.459598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a12355-976c-4e1c-94dd-92e9ffaae26f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:43.459867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a12355-976c-4e1c-94dd-92e9ffaae26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:43.477922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d6a12355-976c-4e1c-94dd-92e9ffaae26f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:43.479156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d6a12355-976c-4e1c-94dd-92e9ffaae26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:43.487394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:43.501556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:43.528835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 162/321] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:43.563485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 160/322] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:43.613425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230d4d3-db61-47bf-97b6-9074f3e08f16 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:43.613758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230d4d3-db61-47bf-97b6-9074f3e08f16 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:43.614006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230d4d3-db61-47bf-97b6-9074f3e08f16 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:43.615507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 163/323] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:43.620823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81634f3a-edd0-4071-ac55-df063ed984d2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:43.621123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81634f3a-edd0-4071-ac55-df063ed984d2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:43.621400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81634f3a-edd0-4071-ac55-df063ed984d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:43.640842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-81634f3a-edd0-4071-ac55-df063ed984d2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:43.642074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-81634f3a-edd0-4071-ac55-df063ed984d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:43.720769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 161/324] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:43.790603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230d4d3-db61-47bf-97b6-9074f3e08f16 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:43.833203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81634f3a-edd0-4071-ac55-df063ed984d2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:43.903891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230d4d3-db61-47bf-97b6-9074f3e08f16 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:43.920723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:43.942057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d08175-e665-4b56-bb7f-4b2fd5572886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:43.943173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d08175-e665-4b56-bb7f-4b2fd5572886 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:43.943573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d08175-e665-4b56-bb7f-4b2fd5572886 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:43.943676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d08175-e665-4b56-bb7f-4b2fd5572886 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:43.945033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d08175-e665-4b56-bb7f-4b2fd5572886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:43.946560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d08175-e665-4b56-bb7f-4b2fd5572886 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:43.948287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 164/325] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:24:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:43.953505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d08175-e665-4b56-bb7f-4b2fd5572886 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:43.956228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81634f3a-edd0-4071-ac55-df063ed984d2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:43.994927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722284-2da0-46b7-92d0-779ccf330fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:43.995574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722284-2da0-46b7-92d0-779ccf330fdb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:43.995858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722284-2da0-46b7-92d0-779ccf330fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:43.996136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722284-2da0-46b7-92d0-779ccf330fdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.004238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:44.008062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722284-2da0-46b7-92d0-779ccf330fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c5722284-2da0-46b7-92d0-779ccf330fdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:44.013001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:44.014110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 162/326] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:44.014906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722284-2da0-46b7-92d0-779ccf330fdb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:44.063502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d08175-e665-4b56-bb7f-4b2fd5572886 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:44.098597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64bcfc-3af7-4cc6-a362-bf694c5324ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:44.099204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64bcfc-3af7-4cc6-a362-bf694c5324ad None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:44.099483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64bcfc-3af7-4cc6-a362-bf694c5324ad None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:44.099756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64bcfc-3af7-4cc6-a362-bf694c5324ad None admin] PATH_INFO: `/v3/groups` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.100408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64bcfc-3af7-4cc6-a362-bf694c5324ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:44.101904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64bcfc-3af7-4cc6-a362-bf694c5324ad None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:44.118981 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 165/327] 10.222.0.17 () {60 vars in 1134 bytes} [Mon Oct 3 12:24:43 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:24:44.119826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64bcfc-3af7-4cc6-a362-bf694c5324ad None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:44.130156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722284-2da0-46b7-92d0-779ccf330fdb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:44.167329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:44.175285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dce6c-b5c3-41fb-ac3f-126dbf2b91a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:44.176231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dce6c-b5c3-41fb-ac3f-126dbf2b91a7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:44.176656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dce6c-b5c3-41fb-ac3f-126dbf2b91a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:44.177076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dce6c-b5c3-41fb-ac3f-126dbf2b91a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.192140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dce6c-b5c3-41fb-ac3f-126dbf2b91a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-292dce6c-b5c3-41fb-ac3f-126dbf2b91a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:44.198212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:44.199165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:44.199972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 163/328] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:44.207099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dce6c-b5c3-41fb-ac3f-126dbf2b91a7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:44.240731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64bcfc-3af7-4cc6-a362-bf694c5324ad None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:44.248958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:44.284550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:44.285186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:44.285798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:44.286082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.287456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:44.287771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:44.289193 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:44.301615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 166/329] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:44.310727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:44.331644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dce6c-b5c3-41fb-ac3f-126dbf2b91a7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:44.371041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:44.371666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:44.371947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:44.372219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.372895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:44.373202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:44.374626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:44.384156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 164/330] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:44.390157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:44.440063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6c925-3b30-48f3-afe8-ad5ea03d9a27 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:44.467487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:44.484677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a50b-f014-4f0a-aa09-ec39b69b44ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:44.485322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a50b-f014-4f0a-aa09-ec39b69b44ed None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:44.485697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a50b-f014-4f0a-aa09-ec39b69b44ed None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:44.485979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a50b-f014-4f0a-aa09-ec39b69b44ed None admin] PATH_INFO: `/v3/users/673d844549ab4c45976317a0785ee2f7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.487158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5a50b-f014-4f0a-aa09-ec39b69b44ed None admin] RBAC: Authorizing `identity:get_user(user_id=673d844549ab4c45976317a0785ee2f7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:44.488635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5a50b-f014-4f0a-aa09-ec39b69b44ed None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:44.491748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 167/331] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:44 2022] GET /identity/v3/users/673d844549ab4c45976317a0785ee2f7 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:44.497704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a50b-f014-4f0a-aa09-ec39b69b44ed None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:44.517075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb97a99-3fed-41a0-a70c-2d0ccb783a51 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:44.543826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:44.560681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4bdea-ecad-4c1b-8ef1-ae1a7d25195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:44.561333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4bdea-ecad-4c1b-8ef1-ae1a7d25195a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:44.561654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4bdea-ecad-4c1b-8ef1-ae1a7d25195a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:44.561936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4bdea-ecad-4c1b-8ef1-ae1a7d25195a None admin] PATH_INFO: `/v3/users/0504174b52f846d5855d4f8e00167334` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.563525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4bdea-ecad-4c1b-8ef1-ae1a7d25195a None admin] RBAC: Authorizing `identity:get_user(user_id=0504174b52f846d5855d4f8e00167334)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:44.565084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4bdea-ecad-4c1b-8ef1-ae1a7d25195a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:44.566846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 165/332] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:44 2022] GET /identity/v3/users/0504174b52f846d5855d4f8e00167334 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:44.572751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4bdea-ecad-4c1b-8ef1-ae1a7d25195a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:44.634882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a50b-f014-4f0a-aa09-ec39b69b44ed None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:44.680320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e1b01-8f53-43fe-aab4-9742a4b5edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:44.681096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1b01-8f53-43fe-aab4-9742a4b5edad None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:44.681488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1b01-8f53-43fe-aab4-9742a4b5edad None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:44.681886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1b01-8f53-43fe-aab4-9742a4b5edad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.682789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e1b01-8f53-43fe-aab4-9742a4b5edad None admin] RBAC: Adding query filter params (role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, user.id=673d844549ab4c45976317a0785ee2f7, scope.system=all) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:44.683207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e1b01-8f53-43fe-aab4-9742a4b5edad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:44.684915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e1b01-8f53-43fe-aab4-9742a4b5edad None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:44.699013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 168/333] 10.222.0.17 () {56 vars in 1308 bytes} [Mon Oct 3 12:24:44 2022] GET /identity/v3/role_assignments?user.id=673d844549ab4c45976317a0785ee2f7&scope.system=all&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:44.713803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4bdea-ecad-4c1b-8ef1-ae1a7d25195a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:44.744331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:44.757102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff55bb-a7ff-4a6d-8616-3636ce53c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:44.757989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff55bb-a7ff-4a6d-8616-3636ce53c341 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:44.758276 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff55bb-a7ff-4a6d-8616-3636ce53c341 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:44.758561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff55bb-a7ff-4a6d-8616-3636ce53c341 None admin] PATH_INFO: `/v3/system/users/0504174b52f846d5855d4f8e00167334/roles/4c92d05fadd144138dd605c7f197e36a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:44.760218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff55bb-a7ff-4a6d-8616-3636ce53c341 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0504174b52f846d5855d4f8e00167334, role_id=4c92d05fadd144138dd605c7f197e36a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:44.762855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff55bb-a7ff-4a6d-8616-3636ce53c341 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:44.776663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 166/334] 10.222.0.17 () {58 vars in 1334 bytes} [Mon Oct 3 12:24:44 2022] PUT /identity/v3/system/users/0504174b52f846d5855d4f8e00167334/roles/4c92d05fadd144138dd605c7f197e36a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:46.775123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05daca5-3457-473f-afb6-a778225ae916 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:46.775672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05daca5-3457-473f-afb6-a778225ae916 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:46.775672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05daca5-3457-473f-afb6-a778225ae916 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:46.777425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 169/335] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:46.783277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bf721-943e-4428-80ae-966b121be3f7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:46.783841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bf721-943e-4428-80ae-966b121be3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:46.783914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bf721-943e-4428-80ae-966b121be3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:46.808835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6c1bf721-943e-4428-80ae-966b121be3f7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:46.810274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6c1bf721-943e-4428-80ae-966b121be3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:46.896755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 167/336] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:47.023589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ae7b-05b4-492a-bf65-8471a626166f None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:47.023880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ae7b-05b4-492a-bf65-8471a626166f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:47.024061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3ae7b-05b4-492a-bf65-8471a626166f None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:47.025881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 170/337] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:47.042451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205751-7d3c-494e-8276-06e878694949 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:47.042887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205751-7d3c-494e-8276-06e878694949 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:47.043214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36205751-7d3c-494e-8276-06e878694949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:47.068824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-36205751-7d3c-494e-8276-06e878694949 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:47.070078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-36205751-7d3c-494e-8276-06e878694949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:47.156838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 168/338] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:47.497441 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3ae7b-05b4-492a-bf65-8471a626166f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:47.521299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d9ee-de89-4bc3-a62c-75156d687912 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:47.521672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d9ee-de89-4bc3-a62c-75156d687912 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:47.521899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d9ee-de89-4bc3-a62c-75156d687912 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:47.523708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 169/339] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:47.539884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bf3d5-01bb-4565-ba57-b0eda8658891 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:47.540180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bf3d5-01bb-4565-ba57-b0eda8658891 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:47.540426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bf3d5-01bb-4565-ba57-b0eda8658891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:47.572675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0b4bf3d5-01bb-4565-ba57-b0eda8658891 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:47.577229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0b4bf3d5-01bb-4565-ba57-b0eda8658891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:47.633833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:47.656545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:47.670078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 170/340] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:47.671079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bf3d5-01bb-4565-ba57-b0eda8658891 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:47.678285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3ae7b-05b4-492a-bf65-8471a626166f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:47.818749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e574a-7591-4ffc-a931-269a1695a5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:47.819708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e574a-7591-4ffc-a931-269a1695a5dd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:47.820354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e574a-7591-4ffc-a931-269a1695a5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:47.820956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e574a-7591-4ffc-a931-269a1695a5dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:47.858535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e574a-7591-4ffc-a931-269a1695a5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-267e574a-7591-4ffc-a931-269a1695a5dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:47.863953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:47.865114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:47.866118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:47.873660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 171/341] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:47.894303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e574a-7591-4ffc-a931-269a1695a5dd None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:47.908505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bf3d5-01bb-4565-ba57-b0eda8658891 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:47.990266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a34ca-a6b5-4376-9394-3368ebe9eb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:47.991103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a34ca-a6b5-4376-9394-3368ebe9eb34 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:47.991480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a34ca-a6b5-4376-9394-3368ebe9eb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:47.991857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a34ca-a6b5-4376-9394-3368ebe9eb34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:48.008798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a34ca-a6b5-4376-9394-3368ebe9eb34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b96a34ca-a6b5-4376-9394-3368ebe9eb34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:48.020958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:48.022195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:48.023185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 171/342] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:48.026311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d1949-ab48-4bf8-a098-d1906fe2f88d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:48.026311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d1949-ab48-4bf8-a098-d1906fe2f88d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:48.026311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d1949-ab48-4bf8-a098-d1906fe2f88d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:48.027253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 172/343] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:48.028044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d1949-ab48-4bf8-a098-d1906fe2f88d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:48.090446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:48.112451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e574a-7591-4ffc-a931-269a1695a5dd None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:48.175991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d0319-5ac9-4290-b8ec-e5182d4687c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:48.176802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d0319-5ac9-4290-b8ec-e5182d4687c8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:48.177331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d0319-5ac9-4290-b8ec-e5182d4687c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:48.177647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d0319-5ac9-4290-b8ec-e5182d4687c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:48.178450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d0319-5ac9-4290-b8ec-e5182d4687c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:48.178761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d0319-5ac9-4290-b8ec-e5182d4687c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:48.180799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d0319-5ac9-4290-b8ec-e5182d4687c8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:48.191270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d1949-ab48-4bf8-a098-d1906fe2f88d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:48.195904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 172/344] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:48.197270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94464220-d2a0-4c20-b976-044cba3ccedf None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:48.197954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94464220-d2a0-4c20-b976-044cba3ccedf None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:48.198240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94464220-d2a0-4c20-b976-044cba3ccedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:48.221920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-94464220-d2a0-4c20-b976-044cba3ccedf None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:48.223129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-94464220-d2a0-4c20-b976-044cba3ccedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:48.233676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:48.234420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:48.234701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:48.234976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:48.235674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:48.235958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:48.237278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:48.238835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:48.250657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 173/345] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:48.251649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:48.318651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 173/346] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:48.320497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94464220-d2a0-4c20-b976-044cba3ccedf None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:48.412606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:48.417348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfe11f-5183-4079-93b3-374c02021282 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:48.461342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23be23-e1be-4dea-97f5-ce48a4f9f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:48.462052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23be23-e1be-4dea-97f5-ce48a4f9f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:48.462334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23be23-e1be-4dea-97f5-ce48a4f9f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:48.462608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23be23-e1be-4dea-97f5-ce48a4f9f2c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:48.477235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23be23-e1be-4dea-97f5-ce48a4f9f2c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ca23be23-e1be-4dea-97f5-ce48a4f9f2c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:48.484008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:48.484947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:48.485801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 174/347] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:48.486485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23be23-e1be-4dea-97f5-ce48a4f9f2c9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:48.562257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94464220-d2a0-4c20-b976-044cba3ccedf None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:48.633777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650c89a-13e4-4bbe-989c-592ee804525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:48.634395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650c89a-13e4-4bbe-989c-592ee804525f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:48.634673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650c89a-13e4-4bbe-989c-592ee804525f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:48.635749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650c89a-13e4-4bbe-989c-592ee804525f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:48.657435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:48.672245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23be23-e1be-4dea-97f5-ce48a4f9f2c9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:48.731568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650c89a-13e4-4bbe-989c-592ee804525f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:48.733606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650c89a-13e4-4bbe-989c-592ee804525f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:48.739512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ccc7-7c38-4ff8-9759-bc05cf2065a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:48.740516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ccc7-7c38-4ff8-9759-bc05cf2065a7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:48.740981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ccc7-7c38-4ff8-9759-bc05cf2065a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:48.741477 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ccc7-7c38-4ff8-9759-bc05cf2065a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:48.779594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:48.843540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ccc7-7c38-4ff8-9759-bc05cf2065a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:48.847133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ccc7-7c38-4ff8-9759-bc05cf2065a7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:48.865568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 174/348] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:48.867291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650c89a-13e4-4bbe-989c-592ee804525f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:48.941025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:48.996371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 175/349] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:48.998107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ccc7-7c38-4ff8-9759-bc05cf2065a7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.017284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650c89a-13e4-4bbe-989c-592ee804525f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.060499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.061283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.061693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.062065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.062862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:49.063262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:49.065391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:49.072742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:49.081115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 175/350] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:49.081856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.136486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ccc7-7c38-4ff8-9759-bc05cf2065a7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.195793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89660eb-5a98-42e8-b99b-a5c87a283fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.196399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89660eb-5a98-42e8-b99b-a5c87a283fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.196678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89660eb-5a98-42e8-b99b-a5c87a283fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.196944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89660eb-5a98-42e8-b99b-a5c87a283fa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.213613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89660eb-5a98-42e8-b99b-a5c87a283fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e89660eb-5a98-42e8-b99b-a5c87a283fa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:49.219787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:49.220753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:49.222227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 176/351] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:49.222984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89660eb-5a98-42e8-b99b-a5c87a283fa9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.244270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb15f2-dc05-4b04-a4b8-66b162907a55 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.256729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:49.291475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2e42-533f-47e4-a02e-ffa3f2e7ccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.291475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2e42-533f-47e4-a02e-ffa3f2e7ccbe None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.291914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2e42-533f-47e4-a02e-ffa3f2e7ccbe None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.292069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2e42-533f-47e4-a02e-ffa3f2e7ccbe None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.293244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2e42-533f-47e4-a02e-ffa3f2e7ccbe None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:49.294758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2e42-533f-47e4-a02e-ffa3f2e7ccbe None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:49.296795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 176/352] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:49 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:49.298254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf918f7-7a37-47db-922e-7becbe71a5c4 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.298541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf918f7-7a37-47db-922e-7becbe71a5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.298933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf918f7-7a37-47db-922e-7becbe71a5c4 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.300572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 177/353] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:49.301306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf918f7-7a37-47db-922e-7becbe71a5c4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.352645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89660eb-5a98-42e8-b99b-a5c87a283fa9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.376784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:49.398252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50665a49-0a81-4bc3-8071-e2dc5c68bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.398906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665a49-0a81-4bc3-8071-e2dc5c68bd8f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.399189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665a49-0a81-4bc3-8071-e2dc5c68bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.399467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50665a49-0a81-4bc3-8071-e2dc5c68bd8f None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.400617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50665a49-0a81-4bc3-8071-e2dc5c68bd8f None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:49.402117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50665a49-0a81-4bc3-8071-e2dc5c68bd8f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:49.403831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 177/354] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:49 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:49.404647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50665a49-0a81-4bc3-8071-e2dc5c68bd8f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.429929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf918f7-7a37-47db-922e-7becbe71a5c4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.472961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dbddb-68f4-407d-a042-cc6f1468efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.474080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dbddb-68f4-407d-a042-cc6f1468efbe None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.474372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dbddb-68f4-407d-a042-cc6f1468efbe None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.474923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dbddb-68f4-407d-a042-cc6f1468efbe None admin] PATH_INFO: `/v3/users/0504174b52f846d5855d4f8e00167334` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.476072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24dbddb-68f4-407d-a042-cc6f1468efbe None admin] RBAC: Authorizing `identity:get_user(user_id=0504174b52f846d5855d4f8e00167334)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:49.480909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24dbddb-68f4-407d-a042-cc6f1468efbe None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:49.480909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 178/355] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:24:49 2022] GET /identity/v3/users/0504174b52f846d5855d4f8e00167334 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:49.481141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea530c6a-3aba-4ab2-a567-c203223dccc1 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.481213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea530c6a-3aba-4ab2-a567-c203223dccc1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.481545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea530c6a-3aba-4ab2-a567-c203223dccc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.502027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ea530c6a-3aba-4ab2-a567-c203223dccc1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:49.503768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ea530c6a-3aba-4ab2-a567-c203223dccc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:49.541491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50665a49-0a81-4bc3-8071-e2dc5c68bd8f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.552053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:49.582212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 179/356] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:49.583067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea530c6a-3aba-4ab2-a567-c203223dccc1 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.585082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d192dc5-67a1-4ad7-87fb-fb461a8bcbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.585738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192dc5-67a1-4ad7-87fb-fb461a8bcbbb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.586026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192dc5-67a1-4ad7-87fb-fb461a8bcbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.586304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d192dc5-67a1-4ad7-87fb-fb461a8bcbbb None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.587494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d192dc5-67a1-4ad7-87fb-fb461a8bcbbb None admin] RBAC: Adding query filter params (name=member) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:49.587494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d192dc5-67a1-4ad7-87fb-fb461a8bcbbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:49.588645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d192dc5-67a1-4ad7-87fb-fb461a8bcbbb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:49.599374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 178/357] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:49.600622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341179e-f9b0-434d-9dd3-165ce5b86212 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.601551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341179e-f9b0-434d-9dd3-165ce5b86212 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.601551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341179e-f9b0-434d-9dd3-165ce5b86212 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.605623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 179/358] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:49.605623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341179e-f9b0-434d-9dd3-165ce5b86212 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.673034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:49.729124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea530c6a-3aba-4ab2-a567-c203223dccc1 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.745003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341179e-f9b0-434d-9dd3-165ce5b86212 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.783456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca662ec-2003-4a78-b29c-a066ece7ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.784107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca662ec-2003-4a78-b29c-a066ece7ffae None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.784390 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca662ec-2003-4a78-b29c-a066ece7ffae None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.784667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca662ec-2003-4a78-b29c-a066ece7ffae None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.793628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca662ec-2003-4a78-b29c-a066ece7ffae None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:49.795290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca662ec-2003-4a78-b29c-a066ece7ffae None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:49.796283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e451-e532-4db9-a7f7-9244b1ced798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.796935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e451-e532-4db9-a7f7-9244b1ced798 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.797393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 180/359] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:49 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:49.798944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca662ec-2003-4a78-b29c-a066ece7ffae None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.801692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e451-e532-4db9-a7f7-9244b1ced798 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.802240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8e451-e532-4db9-a7f7-9244b1ced798 None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.803714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8e451-e532-4db9-a7f7-9244b1ced798 None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:49.805736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8e451-e532-4db9-a7f7-9244b1ced798 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:49.808707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 180/360] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:49 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:49.809799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e451-e532-4db9-a7f7-9244b1ced798 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:49.860878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:49.931416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8e451-e532-4db9-a7f7-9244b1ced798 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.934788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca662ec-2003-4a78-b29c-a066ece7ffae None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:49.949982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:49.972800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e75cf-b6aa-48cf-8b49-f3dc6c775ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.973420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e75cf-b6aa-48cf-8b49-f3dc6c775ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.973728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e75cf-b6aa-48cf-8b49-f3dc6c775ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.974000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e75cf-b6aa-48cf-8b49-f3dc6c775ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.982800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cf7ca-15f7-4ee5-bdd2-3c4df0eb52ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:49.983355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cf7ca-15f7-4ee5-bdd2-3c4df0eb52ec None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:49.984307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cf7ca-15f7-4ee5-bdd2-3c4df0eb52ec None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:49.984585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cf7ca-15f7-4ee5-bdd2-3c4df0eb52ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:49.985350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cf7ca-15f7-4ee5-bdd2-3c4df0eb52ec None admin] RBAC: Adding query filter params (role.id=4c92d05fadd144138dd605c7f197e36a, user.id=0504174b52f846d5855d4f8e00167334, scope.system=all) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:49.985702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cf7ca-15f7-4ee5-bdd2-3c4df0eb52ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:49.988643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4cf7ca-15f7-4ee5-bdd2-3c4df0eb52ec None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:50.004324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 181/361] 10.222.0.17 () {56 vars in 1308 bytes} [Mon Oct 3 12:24:49 2022] GET /identity/v3/role_assignments?user.id=0504174b52f846d5855d4f8e00167334&scope.system=all&role.id=4c92d05fadd144138dd605c7f197e36a => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:50.005450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0d058-8833-4edd-ac41-1d3978d8b1dd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:50.005826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0d058-8833-4edd-ac41-1d3978d8b1dd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:50.006094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0d058-8833-4edd-ac41-1d3978d8b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:50.030157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-0ff0d058-8833-4edd-ac41-1d3978d8b1dd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:50.034686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0ff0d058-8833-4edd-ac41-1d3978d8b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:50.079530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e75cf-b6aa-48cf-8b49-f3dc6c775ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:50.082079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e75cf-b6aa-48cf-8b49-f3dc6c775ae9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:50.146096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 182/362] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:50.147539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0d058-8833-4edd-ac41-1d3978d8b1dd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:50.190137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:50.240093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 181/363] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:50.240897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e75cf-b6aa-48cf-8b49-f3dc6c775ae9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:50.260877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:50.317018 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0d058-8833-4edd-ac41-1d3978d8b1dd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:50.371328 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:50.372217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:50.372720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:50.373160 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:50.374106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] RBAC: Adding query filter params (group.id=04bb7c3b5def4a7583713653d20b693c, role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=159c16b029f94d2d8a928099d7e0ff73) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:50.374583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:50.375452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e75cf-b6aa-48cf-8b49-f3dc6c775ae9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:50.376056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:50.383139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 183/364] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:24:50 2022] GET /identity/v3/role_assignments?group.id=04bb7c3b5def4a7583713653d20b693c&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:50.384426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:50.435240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:50.436840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:50.437572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:50.438099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:50.439198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] RBAC: Adding query filter params (group.id=04bb7c3b5def4a7583713653d20b693c, role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=159c16b029f94d2d8a928099d7e0ff73) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:50.439884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:50.442440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:50.450993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 182/365] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:24:50 2022] GET /identity/v3/role_assignments?group.id=04bb7c3b5def4a7583713653d20b693c&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=9d32107ec65445988af384e49812cfa7 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:50.452924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:50.565721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:50.577957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:50.584116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf0768-ab68-4fab-b0d4-0277b91d5873 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:50.603307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880ed1-e704-458f-895e-e5281330c981 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:50.647551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731af3-9bca-4913-9ddc-8df1801e739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:50.648222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731af3-9bca-4913-9ddc-8df1801e739a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:50.648502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731af3-9bca-4913-9ddc-8df1801e739a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:50.648780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29731af3-9bca-4913-9ddc-8df1801e739a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:50.663359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc35b-797a-42df-92ab-f24882b2d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:50.664233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc35b-797a-42df-92ab-f24882b2d90a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:50.664520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc35b-797a-42df-92ab-f24882b2d90a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:50.664799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc35b-797a-42df-92ab-f24882b2d90a None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:50.667693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc35b-797a-42df-92ab-f24882b2d90a None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:50.669712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc35b-797a-42df-92ab-f24882b2d90a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:50.673346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 183/366] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:50 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:50.678530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc35b-797a-42df-92ab-f24882b2d90a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:50.680395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29731af3-9bca-4913-9ddc-8df1801e739a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-29731af3-9bca-4913-9ddc-8df1801e739a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:50.693840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:50.695527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 184/367] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:50.696525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731af3-9bca-4913-9ddc-8df1801e739a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:50.871540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc35b-797a-42df-92ab-f24882b2d90a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:50.873322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29731af3-9bca-4913-9ddc-8df1801e739a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:50.915391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543052-15b3-41f9-921a-09209e24a359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:50.916052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543052-15b3-41f9-921a-09209e24a359 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:50.916337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543052-15b3-41f9-921a-09209e24a359 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:50.916604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543052-15b3-41f9-921a-09209e24a359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:50.931102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46543052-15b3-41f9-921a-09209e24a359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:50.935330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1281f-15d5-4a94-9ca6-8b7098b13f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:50.938563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1281f-15d5-4a94-9ca6-8b7098b13f19 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-46543052-15b3-41f9-921a-09209e24a359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:50.938686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:50.940144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 184/368] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:50.940941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543052-15b3-41f9-921a-09209e24a359 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:50.942301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1281f-15d5-4a94-9ca6-8b7098b13f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:50.942301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1281f-15d5-4a94-9ca6-8b7098b13f19 None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:50.943858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1281f-15d5-4a94-9ca6-8b7098b13f19 None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:50.945353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1281f-15d5-4a94-9ca6-8b7098b13f19 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:50.948570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 185/369] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:50 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:50.949403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1281f-15d5-4a94-9ca6-8b7098b13f19 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:50.957261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:50.980464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:51.079683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543052-15b3-41f9-921a-09209e24a359 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:51.085755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1281f-15d5-4a94-9ca6-8b7098b13f19 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:51.130574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:51.131561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:51.132063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:51.132537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:51.133507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:51.134050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:51.135798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:51.143337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:51.143960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:51.144239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:51.144595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:51.145271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:51.146108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:51.147835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:51.150146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 185/370] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:51.151281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:51.162932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 186/371] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:51.164093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:51.244784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:51.264964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:51.287868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90db65-b0ec-47dd-a454-ba75a69ff34a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:51.289228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304fcc7-58d2-488a-bba5-7ad8036c8701 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:51.331451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:51.332224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:51.332691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:51.333059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:51.333499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33554e-9aee-47f9-990e-48f0e94ff8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:51.334039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] RBAC: Adding query filter params (group.id=04bb7c3b5def4a7583713653d20b693c, role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=c37a56c851e44bbdae9b44a245897c27) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:51.334450 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:51.334662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33554e-9aee-47f9-990e-48f0e94ff8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:51.335083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33554e-9aee-47f9-990e-48f0e94ff8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:51.335500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33554e-9aee-47f9-990e-48f0e94ff8a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:51.336255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:51.343130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 186/372] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:24:51 2022] GET /identity/v3/role_assignments?group.id=04bb7c3b5def4a7583713653d20b693c&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:51.344094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:51.513378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33554e-9aee-47f9-990e-48f0e94ff8a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:51.514831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33554e-9aee-47f9-990e-48f0e94ff8a7 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:51.529693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccc993-d82d-45cd-b23f-529f7a7485b2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:51.573206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe66c-412b-473d-a1a4-9273a8b84630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:51.573876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe66c-412b-473d-a1a4-9273a8b84630 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:51.574157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe66c-412b-473d-a1a4-9273a8b84630 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:51.574427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efe66c-412b-473d-a1a4-9273a8b84630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:51.581888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:51.654906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe66c-412b-473d-a1a4-9273a8b84630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:51.656461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efe66c-412b-473d-a1a4-9273a8b84630 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:51.770114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 187/373] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:51.775777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe66c-412b-473d-a1a4-9273a8b84630 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:51.789846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:51.833428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 187/374] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:51.846767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:51.847806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33554e-9aee-47f9-990e-48f0e94ff8a7 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:51.937505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efe66c-412b-473d-a1a4-9273a8b84630 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:51.984738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe143c9-6382-476e-9fce-f6dd1b37d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:51.985390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe143c9-6382-476e-9fce-f6dd1b37d3ce None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:51.985750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe143c9-6382-476e-9fce-f6dd1b37d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:51.986030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe143c9-6382-476e-9fce-f6dd1b37d3ce None admin] PATH_INFO: `/v3/projects/55a504954dfa4713bb307e2b5ecea75a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:51.990289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe143c9-6382-476e-9fce-f6dd1b37d3ce None admin] RBAC: Authorizing `identity:get_project(project_id=55a504954dfa4713bb307e2b5ecea75a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:51.991781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe143c9-6382-476e-9fce-f6dd1b37d3ce None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:51.993979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 188/375] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:51 2022] GET /identity/v3/projects/55a504954dfa4713bb307e2b5ecea75a => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:51.999163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe143c9-6382-476e-9fce-f6dd1b37d3ce None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:52.026231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33554e-9aee-47f9-990e-48f0e94ff8a7 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:52.075987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e9a61-c76f-461e-9231-acc828cba449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:52.076631 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e9a61-c76f-461e-9231-acc828cba449 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:52.076921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e9a61-c76f-461e-9231-acc828cba449 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:52.077199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e9a61-c76f-461e-9231-acc828cba449 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:52.078417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e9a61-c76f-461e-9231-acc828cba449 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:52.080551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e9a61-c76f-461e-9231-acc828cba449 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:52.082622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 188/376] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:51 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:52.088593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e9a61-c76f-461e-9231-acc828cba449 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:52.191054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:52.218376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe143c9-6382-476e-9fce-f6dd1b37d3ce None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:52.225867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:52.256628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e9a61-c76f-461e-9231-acc828cba449 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:52.292188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de33f-140a-48d4-be9c-9b3686be1fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:52.292772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de33f-140a-48d4-be9c-9b3686be1fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:52.293208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de33f-140a-48d4-be9c-9b3686be1fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:52.293493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de33f-140a-48d4-be9c-9b3686be1fa5 None admin] PATH_INFO: `/v3/groups/30c0fcdb12744a0398b92b7c8c230d64` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:52.304705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a7161-afd9-4194-9769-029013da0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:52.305661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a7161-afd9-4194-9769-029013da0841 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:52.306110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a7161-afd9-4194-9769-029013da0841 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:52.306955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a7161-afd9-4194-9769-029013da0841 None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:52.307532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264de33f-140a-48d4-be9c-9b3686be1fa5 None admin] RBAC: Authorizing `identity:get_group(group_id=30c0fcdb12744a0398b92b7c8c230d64)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:52.308730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a7161-afd9-4194-9769-029013da0841 None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:52.309004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264de33f-140a-48d4-be9c-9b3686be1fa5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:52.311147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a7161-afd9-4194-9769-029013da0841 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:52.311285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 189/377] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:51 2022] GET /identity/v3/groups/30c0fcdb12744a0398b92b7c8c230d64 => generated 229 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:52.317624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 189/378] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:52 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:52.319327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de33f-140a-48d4-be9c-9b3686be1fa5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:52.320474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a7161-afd9-4194-9769-029013da0841 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:52.429756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a7161-afd9-4194-9769-029013da0841 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:52.447645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:52.485026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70f15e-c743-4103-ab8b-a2b11b48787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:52.486114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70f15e-c743-4103-ab8b-a2b11b48787c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:52.486438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70f15e-c743-4103-ab8b-a2b11b48787c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:52.486714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70f15e-c743-4103-ab8b-a2b11b48787c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:52.487449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70f15e-c743-4103-ab8b-a2b11b48787c None admin] RBAC: Adding query filter params (group.id=30c0fcdb12744a0398b92b7c8c230d64, role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=55a504954dfa4713bb307e2b5ecea75a) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:52.487765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70f15e-c743-4103-ab8b-a2b11b48787c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:52.490136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70f15e-c743-4103-ab8b-a2b11b48787c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:52.501352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de33f-140a-48d4-be9c-9b3686be1fa5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:52.505691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 190/379] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:24:52 2022] GET /identity/v3/role_assignments?group.id=30c0fcdb12744a0398b92b7c8c230d64&scope.project.id=55a504954dfa4713bb307e2b5ecea75a&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:52.544976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a60d9f-cc59-46d0-aa5e-5c2543e5bacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:52.545586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60d9f-cc59-46d0-aa5e-5c2543e5bacc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:52.545879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60d9f-cc59-46d0-aa5e-5c2543e5bacc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:52.546161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a60d9f-cc59-46d0-aa5e-5c2543e5bacc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:52.546898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a60d9f-cc59-46d0-aa5e-5c2543e5bacc None admin] RBAC: Adding query filter params (group.id=04bb7c3b5def4a7583713653d20b693c, role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=c37a56c851e44bbdae9b44a245897c27) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:52.547217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a60d9f-cc59-46d0-aa5e-5c2543e5bacc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:52.548650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a60d9f-cc59-46d0-aa5e-5c2543e5bacc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:52.555354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 190/380] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:24:52 2022] GET /identity/v3/role_assignments?group.id=04bb7c3b5def4a7583713653d20b693c&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=9d32107ec65445988af384e49812cfa7 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:53.073896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae979ef-9454-4ee6-a33b-7864753e252a None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:53.074464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae979ef-9454-4ee6-a33b-7864753e252a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:53.074464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae979ef-9454-4ee6-a33b-7864753e252a None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:53.076164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 191/381] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:53.082319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825f37-17f1-47f1-91c6-720f242bd9ef None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:53.082621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825f37-17f1-47f1-91c6-720f242bd9ef None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:53.082874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23825f37-17f1-47f1-91c6-720f242bd9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:53.106535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-23825f37-17f1-47f1-91c6-720f242bd9ef None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:53.107752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-23825f37-17f1-47f1-91c6-720f242bd9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:53.137803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:53.193284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e22de-65c3-4596-a30c-2c17ea231e26 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:53.193630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e22de-65c3-4596-a30c-2c17ea231e26 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:53.193879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e22de-65c3-4596-a30c-2c17ea231e26 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:53.195398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 192/382] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:53.200735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2d7b-ba7f-4b8d-9799-aaa7a8d0af06 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:53.201021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2d7b-ba7f-4b8d-9799-aaa7a8d0af06 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:53.201302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2d7b-ba7f-4b8d-9799-aaa7a8d0af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:53.210496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 191/383] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:53.226138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-201c2d7b-ba7f-4b8d-9799-aaa7a8d0af06 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:53.227388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-201c2d7b-ba7f-4b8d-9799-aaa7a8d0af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:53.344234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 193/384] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:24:53.593605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23825f37-17f1-47f1-91c6-720f242bd9ef None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:53.688844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2d7b-ba7f-4b8d-9799-aaa7a8d0af06 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:53.752319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23825f37-17f1-47f1-91c6-720f242bd9ef None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:53.825868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a746e-fda3-4a45-b74d-9abed3ae9cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:53.826535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a746e-fda3-4a45-b74d-9abed3ae9cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:53.826812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a746e-fda3-4a45-b74d-9abed3ae9cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:53.827082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a746e-fda3-4a45-b74d-9abed3ae9cb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:53.853323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a746e-fda3-4a45-b74d-9abed3ae9cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-dd5a746e-fda3-4a45-b74d-9abed3ae9cb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:53.860048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:53.861093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:53.861937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:53.863027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 192/385] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:53.867144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a746e-fda3-4a45-b74d-9abed3ae9cb9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:53.899979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2d7b-ba7f-4b8d-9799-aaa7a8d0af06 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:53.914295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:53.919725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:53.985877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1959f3-76e4-4b80-bc1e-2c6561b58fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:53.987002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1959f3-76e4-4b80-bc1e-2c6561b58fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:53.987279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1959f3-76e4-4b80-bc1e-2c6561b58fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:53.987548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1959f3-76e4-4b80-bc1e-2c6561b58fc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.012246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1959f3-76e4-4b80-bc1e-2c6561b58fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-ba1959f3-76e4-4b80-bc1e-2c6561b58fc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:54.017176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:54.018153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:54.018938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 194/386] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:54.026170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1959f3-76e4-4b80-bc1e-2c6561b58fc9 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:54.053035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a746e-fda3-4a45-b74d-9abed3ae9cb9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:54.098354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:54.098981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.099259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.099525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.100202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:54.100502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:54.101977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:54.125075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 193/387] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:54.134591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:54.265607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1959f3-76e4-4b80-bc1e-2c6561b58fc9 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:54.290342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:54.308972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9a4c6-e68d-4261-9399-8f4b8ee31822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:54.309742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a4c6-e68d-4261-9399-8f4b8ee31822 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.310333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a4c6-e68d-4261-9399-8f4b8ee31822 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.310680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a4c6-e68d-4261-9399-8f4b8ee31822 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.311861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9a4c6-e68d-4261-9399-8f4b8ee31822 None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:54.312232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9a4c6-e68d-4261-9399-8f4b8ee31822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:54.314047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f9a4c6-e68d-4261-9399-8f4b8ee31822 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:54.318842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b0786-56c3-4260-a098-cfd2dfd52603 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:54.329580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 195/388] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:54.329580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07efc3b-b7c5-475c-baf9-41fb5cc7b852 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.329580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07efc3b-b7c5-475c-baf9-41fb5cc7b852 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.329580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07efc3b-b7c5-475c-baf9-41fb5cc7b852 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.329580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 196/389] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:54.334418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07efc3b-b7c5-475c-baf9-41fb5cc7b852 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:54.369380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bbf25-49a4-4e81-bb19-5d05471c004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:54.370273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbf25-49a4-4e81-bb19-5d05471c004c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.370655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbf25-49a4-4e81-bb19-5d05471c004c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.371033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbf25-49a4-4e81-bb19-5d05471c004c None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.372530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bbf25-49a4-4e81-bb19-5d05471c004c None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:54.374138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bbf25-49a4-4e81-bb19-5d05471c004c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:54.375757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:54.381581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 194/390] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:54 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:54.381581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29667b-975b-47f7-b4a5-1d408389ed4c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.381581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29667b-975b-47f7-b4a5-1d408389ed4c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.381581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29667b-975b-47f7-b4a5-1d408389ed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.400366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9e29667b-975b-47f7-b4a5-1d408389ed4c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:54.401990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9e29667b-975b-47f7-b4a5-1d408389ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:54.478057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07efc3b-b7c5-475c-baf9-41fb5cc7b852 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:54.481869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 195/391] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:54.482786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29667b-975b-47f7-b4a5-1d408389ed4c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:54.520408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5c95-8a35-4f95-b56b-5a8865a96c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:54.521578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5c95-8a35-4f95-b56b-5a8865a96c22 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.522159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5c95-8a35-4f95-b56b-5a8865a96c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.522908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5c95-8a35-4f95-b56b-5a8865a96c22 None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.524730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff5c95-8a35-4f95-b56b-5a8865a96c22 None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:54.526430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff5c95-8a35-4f95-b56b-5a8865a96c22 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:54.529120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 197/392] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:54 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:54.535262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5c95-8a35-4f95-b56b-5a8865a96c22 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:54.664924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:54.703424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29667b-975b-47f7-b4a5-1d408389ed4c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:54.731297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:54.737957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5c95-8a35-4f95-b56b-5a8865a96c22 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:54.780911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb433e-ec01-47ee-a73a-7c48393c92ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:54.783668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb433e-ec01-47ee-a73a-7c48393c92ff None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.785943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb433e-ec01-47ee-a73a-7c48393c92ff None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.786488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb433e-ec01-47ee-a73a-7c48393c92ff None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.788906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb433e-ec01-47ee-a73a-7c48393c92ff None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:54.791285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb433e-ec01-47ee-a73a-7c48393c92ff None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:54.801382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 196/393] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:54 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:54.805336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb433e-ec01-47ee-a73a-7c48393c92ff None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:54.811691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dddbb-bbc7-4e64-8e8d-db4d5845a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:54.812335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dddbb-bbc7-4e64-8e8d-db4d5845a0ef None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.812793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dddbb-bbc7-4e64-8e8d-db4d5845a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.813086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dddbb-bbc7-4e64-8e8d-db4d5845a0ef None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.814438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dddbb-bbc7-4e64-8e8d-db4d5845a0ef None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:54.815887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374dddbb-bbc7-4e64-8e8d-db4d5845a0ef None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:54.822191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 198/394] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:54 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:54.823130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dddbb-bbc7-4e64-8e8d-db4d5845a0ef None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:54.935292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb433e-ec01-47ee-a73a-7c48393c92ff None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:54.951987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dddbb-bbc7-4e64-8e8d-db4d5845a0ef None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:54.981765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e56e2-836c-4578-8f94-e45165982164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:54.982717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e56e2-836c-4578-8f94-e45165982164 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.982999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e56e2-836c-4578-8f94-e45165982164 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.983277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e56e2-836c-4578-8f94-e45165982164 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73/groups/04bb7c3b5def4a7583713653d20b693c/roles/9d32107ec65445988af384e49812cfa7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:54.986573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e56e2-836c-4578-8f94-e45165982164 None admin] RBAC: Authorizing `identity:create_grant(project_id=159c16b029f94d2d8a928099d7e0ff73, group_id=04bb7c3b5def4a7583713653d20b693c, role_id=9d32107ec65445988af384e49812cfa7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:54.988864 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e56e2-836c-4578-8f94-e45165982164 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:54.997734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf17788-5b67-4931-b2f8-8e903877efc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:54.998434 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf17788-5b67-4931-b2f8-8e903877efc7 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:54.998717 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf17788-5b67-4931-b2f8-8e903877efc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:54.998999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf17788-5b67-4931-b2f8-8e903877efc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.007265 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 197/395] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Oct 3 12:24:54 2022] PUT /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73/groups/04bb7c3b5def4a7583713653d20b693c/roles/9d32107ec65445988af384e49812cfa7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:55.008278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e56e2-836c-4578-8f94-e45165982164 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:55.019836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf17788-5b67-4931-b2f8-8e903877efc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:55.022739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-4cf17788-5b67-4931-b2f8-8e903877efc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:55.027333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:55.028713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:55.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:55.034054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 199/396] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:55.051043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf17788-5b67-4931-b2f8-8e903877efc7 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:55.109843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:55.143218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e56e2-836c-4578-8f94-e45165982164 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:55.187348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd515b-2596-402f-9771-f55447cb80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:55.188045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd515b-2596-402f-9771-f55447cb80f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.188328 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd515b-2596-402f-9771-f55447cb80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.188604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd515b-2596-402f-9771-f55447cb80f2 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73/groups/04bb7c3b5def4a7583713653d20b693c/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.194060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd515b-2596-402f-9771-f55447cb80f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=159c16b029f94d2d8a928099d7e0ff73, group_id=04bb7c3b5def4a7583713653d20b693c, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:55.196952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd515b-2596-402f-9771-f55447cb80f2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:55.217332 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 198/397] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Oct 3 12:24:55 2022] PUT /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73/groups/04bb7c3b5def4a7583713653d20b693c/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:55.219021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f491bce-6698-4dc4-aaa2-999c14db27f1 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.219473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f491bce-6698-4dc4-aaa2-999c14db27f1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.219963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f491bce-6698-4dc4-aaa2-999c14db27f1 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.222342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 199/398] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:55.228391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c0e9b-cc60-42c5-bc40-b30ea5bc6cf4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.229010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c0e9b-cc60-42c5-bc40-b30ea5bc6cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.230283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c0e9b-cc60-42c5-bc40-b30ea5bc6cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.255608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d82c0e9b-cc60-42c5-bc40-b30ea5bc6cf4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:55.257824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d82c0e9b-cc60-42c5-bc40-b30ea5bc6cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:55.258252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf17788-5b67-4931-b2f8-8e903877efc7 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:55.307524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04417f-0ed2-4556-99e4-1b7482a959dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:55.308411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04417f-0ed2-4556-99e4-1b7482a959dd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.308490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04417f-0ed2-4556-99e4-1b7482a959dd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.308745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04417f-0ed2-4556-99e4-1b7482a959dd None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.309475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04417f-0ed2-4556-99e4-1b7482a959dd None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:55.309981 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04417f-0ed2-4556-99e4-1b7482a959dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:55.311612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04417f-0ed2-4556-99e4-1b7482a959dd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:55.321623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 200/399] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:55.327691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb569f-27a4-4b98-84ea-8a51c362c3be None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.327973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb569f-27a4-4b98-84ea-8a51c362c3be None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.328249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb569f-27a4-4b98-84ea-8a51c362c3be None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.330242 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 201/400] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:55.331464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb569f-27a4-4b98-84ea-8a51c362c3be None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:55.368333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 200/401] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:55.368882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:55.374766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67f5d-a098-4d1e-ba07-e10e0f21c5f3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.375318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67f5d-a098-4d1e-ba07-e10e0f21c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.375738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67f5d-a098-4d1e-ba07-e10e0f21c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.422782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2ff67f5d-a098-4d1e-ba07-e10e0f21c5f3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:55.424515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2ff67f5d-a098-4d1e-ba07-e10e0f21c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:55.459784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:55.472745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb569f-27a4-4b98-84ea-8a51c362c3be None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:55.506961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 201/402] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:55.514061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e78f1-54bc-4f19-927c-b5cd0d9105d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:55.514926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e78f1-54bc-4f19-927c-b5cd0d9105d8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.515351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e78f1-54bc-4f19-927c-b5cd0d9105d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.515767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e78f1-54bc-4f19-927c-b5cd0d9105d8 None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.517034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e78f1-54bc-4f19-927c-b5cd0d9105d8 None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:55.519200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e78f1-54bc-4f19-927c-b5cd0d9105d8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:55.521249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 202/403] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:55 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:55.527345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff67f5d-a098-4d1e-ba07-e10e0f21c5f3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:55.641072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff67f5d-a098-4d1e-ba07-e10e0f21c5f3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:55.673914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:55.678459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e78f1-54bc-4f19-927c-b5cd0d9105d8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:55.685004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933cb28-2769-4b88-be4b-33ca11dc12d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:55.685937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933cb28-2769-4b88-be4b-33ca11dc12d4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.686221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933cb28-2769-4b88-be4b-33ca11dc12d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.686498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933cb28-2769-4b88-be4b-33ca11dc12d4 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.687731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933cb28-2769-4b88-be4b-33ca11dc12d4 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:55.689748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933cb28-2769-4b88-be4b-33ca11dc12d4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:55.691706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 202/404] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:55 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:55.711911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933cb28-2769-4b88-be4b-33ca11dc12d4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:55.845176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e78f1-54bc-4f19-927c-b5cd0d9105d8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:55.916540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27a16-f582-4aa3-ab8c-c7a99103cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:55.917113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27a16-f582-4aa3-ab8c-c7a99103cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.917393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27a16-f582-4aa3-ab8c-c7a99103cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.917704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb27a16-f582-4aa3-ab8c-c7a99103cca2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.920295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933cb28-2769-4b88-be4b-33ca11dc12d4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:55.935539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb27a16-f582-4aa3-ab8c-c7a99103cca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-9fb27a16-f582-4aa3-ab8c-c7a99103cca2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:55.943739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:55.944710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:24:55.945538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:55.948077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 203/405] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:24:55.949233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27a16-f582-4aa3-ab8c-c7a99103cca2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:55.966822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d819-55d7-4e01-bb46-3d4cd8491c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:55.967701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d819-55d7-4e01-bb46-3d4cd8491c2b None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:55.968059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d819-55d7-4e01-bb46-3d4cd8491c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:55.968428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d819-55d7-4e01-bb46-3d4cd8491c2b None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27/groups/04bb7c3b5def4a7583713653d20b693c/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:55.970838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d819-55d7-4e01-bb46-3d4cd8491c2b None admin] RBAC: Authorizing `identity:create_grant(project_id=c37a56c851e44bbdae9b44a245897c27, group_id=04bb7c3b5def4a7583713653d20b693c, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:55.972663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d819-55d7-4e01-bb46-3d4cd8491c2b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:55.978177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:55.994992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 203/406] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Oct 3 12:24:55 2022] PUT /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27/groups/04bb7c3b5def4a7583713653d20b693c/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:24:55.996342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d819-55d7-4e01-bb46-3d4cd8491c2b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:56.069221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:56.123123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d819-55d7-4e01-bb46-3d4cd8491c2b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:56.132450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb27a16-f582-4aa3-ab8c-c7a99103cca2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:56.170649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a25b2-8e48-42d5-b7e3-bba9acac435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:56.170649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a25b2-8e48-42d5-b7e3-bba9acac435f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:56.170935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a25b2-8e48-42d5-b7e3-bba9acac435f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:56.171169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a25b2-8e48-42d5-b7e3-bba9acac435f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:56.185969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a25b2-8e48-42d5-b7e3-bba9acac435f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-574a25b2-8e48-42d5-b7e3-bba9acac435f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:56.191532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:56.192471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:56.193302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 204/407] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:56.208016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a25b2-8e48-42d5-b7e3-bba9acac435f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:56.210622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:56.211264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:56.211542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:56.211816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:56.212493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:56.212858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:56.214308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:56.224414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 204/408] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:56.230179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:56.349378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d166abd-9f23-42c5-997f-0848fabea201 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:56.351770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:56.377952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:56.382183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a25b2-8e48-42d5-b7e3-bba9acac435f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:56.408746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeff3f-219c-4a62-a2a8-7b56585042c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:56.409397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeff3f-219c-4a62-a2a8-7b56585042c7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:56.409702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeff3f-219c-4a62-a2a8-7b56585042c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:56.409976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eeff3f-219c-4a62-a2a8-7b56585042c7 None admin] PATH_INFO: `/v3/groups/30c0fcdb12744a0398b92b7c8c230d64` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:56.411140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eeff3f-219c-4a62-a2a8-7b56585042c7 None admin] RBAC: Authorizing `identity:get_group(group_id=30c0fcdb12744a0398b92b7c8c230d64)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:56.412612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eeff3f-219c-4a62-a2a8-7b56585042c7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:56.414934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 205/409] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:56 2022] GET /identity/v3/groups/30c0fcdb12744a0398b92b7c8c230d64 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:56.425214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeff3f-219c-4a62-a2a8-7b56585042c7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:56.450745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:56.451365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:56.451640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:56.451908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:56.453211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:56.453544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:56.455601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:56.473342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 205/410] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:24:56.480713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:56.607842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eeff3f-219c-4a62-a2a8-7b56585042c7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:56.676815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc97a5-2946-4208-bed1-5676a4a5e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:56.677420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc97a5-2946-4208-bed1-5676a4a5e158 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:56.677664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc97a5-2946-4208-bed1-5676a4a5e158 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:56.677941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc97a5-2946-4208-bed1-5676a4a5e158 None admin] PATH_INFO: `/v3/projects/55a504954dfa4713bb307e2b5ecea75a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:56.679221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc97a5-2946-4208-bed1-5676a4a5e158 None admin] RBAC: Authorizing `identity:get_project(project_id=55a504954dfa4713bb307e2b5ecea75a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:56.680667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc97a5-2946-4208-bed1-5676a4a5e158 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:56.681696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034e794-b156-415c-a8aa-c99d83c0b6fb None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:56.682710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 206/411] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:56 2022] GET /identity/v3/projects/55a504954dfa4713bb307e2b5ecea75a => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:56.700084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc97a5-2946-4208-bed1-5676a4a5e158 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:56.749959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769212-0696-49d6-bbae-b58b6a4364b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:56.750958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769212-0696-49d6-bbae-b58b6a4364b0 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:56.751241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769212-0696-49d6-bbae-b58b6a4364b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:56.751550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769212-0696-49d6-bbae-b58b6a4364b0 None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:56.754221 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769212-0696-49d6-bbae-b58b6a4364b0 None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:56.755939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769212-0696-49d6-bbae-b58b6a4364b0 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:56.759835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 206/412] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:56 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:56.767077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769212-0696-49d6-bbae-b58b6a4364b0 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:56.788359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:56.818993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:56.910000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc97a5-2946-4208-bed1-5676a4a5e158 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:56.978218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769212-0696-49d6-bbae-b58b6a4364b0 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:56.992548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161c434-2f4e-4885-ac4b-1a563117a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:56.993245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161c434-2f4e-4885-ac4b-1a563117a91e None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:56.993542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161c434-2f4e-4885-ac4b-1a563117a91e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:56.993828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161c434-2f4e-4885-ac4b-1a563117a91e None admin] PATH_INFO: `/v3/projects/55a504954dfa4713bb307e2b5ecea75a/groups/30c0fcdb12744a0398b92b7c8c230d64/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:56.998065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161c434-2f4e-4885-ac4b-1a563117a91e None admin] RBAC: Authorizing `identity:create_grant(project_id=55a504954dfa4713bb307e2b5ecea75a, group_id=30c0fcdb12744a0398b92b7c8c230d64, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:56.999643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6161c434-2f4e-4885-ac4b-1a563117a91e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:57.024723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 207/413] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Oct 3 12:24:56 2022] PUT /identity/v3/projects/55a504954dfa4713bb307e2b5ecea75a/groups/30c0fcdb12744a0398b92b7c8c230d64/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:57.050178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04a955-cf6e-467b-bd8c-7d524e26ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:57.050860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04a955-cf6e-467b-bd8c-7d524e26ac68 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:57.051147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04a955-cf6e-467b-bd8c-7d524e26ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:57.051467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04a955-cf6e-467b-bd8c-7d524e26ac68 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:57.053025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04a955-cf6e-467b-bd8c-7d524e26ac68 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:57.054893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04a955-cf6e-467b-bd8c-7d524e26ac68 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:57.057930 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 207/414] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:56 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:57.063145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161c434-2f4e-4885-ac4b-1a563117a91e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:57.218831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161c434-2f4e-4885-ac4b-1a563117a91e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:57.235156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:57.265884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629b8df-ace2-4527-9433-735bd35987f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:57.266561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629b8df-ace2-4527-9433-735bd35987f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:57.266840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629b8df-ace2-4527-9433-735bd35987f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:57.267601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629b8df-ace2-4527-9433-735bd35987f3 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27/groups/04bb7c3b5def4a7583713653d20b693c/roles/9d32107ec65445988af384e49812cfa7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:57.272302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629b8df-ace2-4527-9433-735bd35987f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c37a56c851e44bbdae9b44a245897c27, group_id=04bb7c3b5def4a7583713653d20b693c, role_id=9d32107ec65445988af384e49812cfa7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:57.273848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629b8df-ace2-4527-9433-735bd35987f3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:57.294160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 208/415] 10.222.0.17 () {58 vars in 1442 bytes} [Mon Oct 3 12:24:57 2022] PUT /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27/groups/04bb7c3b5def4a7583713653d20b693c/roles/9d32107ec65445988af384e49812cfa7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:24:57.624512 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a255e-80c1-465e-801d-a10d0c09cb5a None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:57.624997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a255e-80c1-465e-801d-a10d0c09cb5a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:57.625071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a255e-80c1-465e-801d-a10d0c09cb5a None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:57.627240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 208/416] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:57.632672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47952cc-887d-47df-870b-25bec7561279 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:57.632954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47952cc-887d-47df-870b-25bec7561279 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:57.633227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47952cc-887d-47df-870b-25bec7561279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:57.658573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e47952cc-887d-47df-870b-25bec7561279 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:57.659807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e47952cc-887d-47df-870b-25bec7561279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:57.754704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 209/417] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:57.902178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd9c9-b7a6-468e-b809-ea5bbc7c2c9d None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:57.902564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd9c9-b7a6-468e-b809-ea5bbc7c2c9d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:57.902897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd9c9-b7a6-468e-b809-ea5bbc7c2c9d None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:57.904382 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 209/418] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:57.910040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7ff54-182b-419e-8dc7-5fbd83b26bfe None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:57.910325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7ff54-182b-419e-8dc7-5fbd83b26bfe None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:57.910601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7ff54-182b-419e-8dc7-5fbd83b26bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:57.934537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-59c7ff54-182b-419e-8dc7-5fbd83b26bfe None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:57.935741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-59c7ff54-182b-419e-8dc7-5fbd83b26bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:58.022928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 210/419] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:58.084090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd9c9-b7a6-468e-b809-ea5bbc7c2c9d None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:58.187049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:58.213950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd9c9-b7a6-468e-b809-ea5bbc7c2c9d None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:58.252380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f41071-06e1-4619-b889-c0c07722770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:58.253009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41071-06e1-4619-b889-c0c07722770a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:58.253338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41071-06e1-4619-b889-c0c07722770a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:58.253641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f41071-06e1-4619-b889-c0c07722770a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:58.265154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f41071-06e1-4619-b889-c0c07722770a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-90f41071-06e1-4619-b889-c0c07722770a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:58.270323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:58.271204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:58.272000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 210/420] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:58.277376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7ff54-182b-419e-8dc7-5fbd83b26bfe None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:58.324060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:58.405695 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7ff54-182b-419e-8dc7-5fbd83b26bfe None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:58.410707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f41071-06e1-4619-b889-c0c07722770a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:58.482841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:58.483398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:58.483723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:58.483996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:58.484662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:58.484973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:58.486975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:58.504961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 211/421] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:58.511999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:58.613541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f41071-06e1-4619-b889-c0c07722770a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:58.653017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005b536-45ba-4d26-8c54-ff08c428eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:58.653670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005b536-45ba-4d26-8c54-ff08c428eb7f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:58.653941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005b536-45ba-4d26-8c54-ff08c428eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:58.654211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005b536-45ba-4d26-8c54-ff08c428eb7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:58.657234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:58.672025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005b536-45ba-4d26-8c54-ff08c428eb7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-0005b536-45ba-4d26-8c54-ff08c428eb7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:58.681556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:58.682484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:24:58.683279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 211/422] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:24:58.689880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005b536-45ba-4d26-8c54-ff08c428eb7f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:58.721805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:58.730862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766e985-a097-4e3d-accb-8e932e85c8cd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:58.785965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9decf-a2ee-4198-8a1f-22d2a8bc96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:58.787523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9decf-a2ee-4198-8a1f-22d2a8bc96dd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:58.787964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9decf-a2ee-4198-8a1f-22d2a8bc96dd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:58.788542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9decf-a2ee-4198-8a1f-22d2a8bc96dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:58.842048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005b536-45ba-4d26-8c54-ff08c428eb7f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:58.888138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36297153-828e-444d-9d30-3ae6891a97dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:58.888766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297153-828e-444d-9d30-3ae6891a97dc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:58.889053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297153-828e-444d-9d30-3ae6891a97dc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:58.889331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36297153-828e-444d-9d30-3ae6891a97dc None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:58.890037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36297153-828e-444d-9d30-3ae6891a97dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:58.890352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36297153-828e-444d-9d30-3ae6891a97dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:58.891733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36297153-828e-444d-9d30-3ae6891a97dc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:58.892744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9decf-a2ee-4198-8a1f-22d2a8bc96dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:58.894570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9decf-a2ee-4198-8a1f-22d2a8bc96dd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:58.902617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 212/423] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:58.903984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175c23-1f7a-4445-ac2d-a82859de1b9d None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:58.904270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175c23-1f7a-4445-ac2d-a82859de1b9d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:58.904545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175c23-1f7a-4445-ac2d-a82859de1b9d None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:58.906191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 213/424] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:24:58.908874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175c23-1f7a-4445-ac2d-a82859de1b9d None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:58.972176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:59.019049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:59.025427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175c23-1f7a-4445-ac2d-a82859de1b9d None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:59.031195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 212/425] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:59.031195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03e23-c458-46a9-a1f1-4aeb1fa205fc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.031195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03e23-c458-46a9-a1f1-4aeb1fa205fc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.031195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e03e23-c458-46a9-a1f1-4aeb1fa205fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.054446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-57e03e23-c458-46a9-a1f1-4aeb1fa205fc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:24:59.056769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-57e03e23-c458-46a9-a1f1-4aeb1fa205fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:24:59.070339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0d13b-8fb1-4f3c-9011-7a6f2b080dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:59.070974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d13b-8fb1-4f3c-9011-7a6f2b080dab None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.071257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d13b-8fb1-4f3c-9011-7a6f2b080dab None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.071534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d13b-8fb1-4f3c-9011-7a6f2b080dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.149847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0d13b-8fb1-4f3c-9011-7a6f2b080dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:59.151331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0d13b-8fb1-4f3c-9011-7a6f2b080dab None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:59.155768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 213/426] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:24:59.156863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03e23-c458-46a9-a1f1-4aeb1fa205fc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:59.217863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:59.273293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 214/427] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:24:59.278895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0d13b-8fb1-4f3c-9011-7a6f2b080dab None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:59.292586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e03e23-c458-46a9-a1f1-4aeb1fa205fc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:59.327039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:59.339191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8c524-1bec-426d-a635-0405420bc4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:59.340203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c524-1bec-426d-a635-0405420bc4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.340695 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c524-1bec-426d-a635-0405420bc4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.341147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c524-1bec-426d-a635-0405420bc4b3 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.342643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8c524-1bec-426d-a635-0405420bc4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:59.344312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8c524-1bec-426d-a635-0405420bc4b3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:59.346806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 214/428] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:59 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:59.358784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8c524-1bec-426d-a635-0405420bc4b3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:59.409313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0d13b-8fb1-4f3c-9011-7a6f2b080dab None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:59.471528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38521a40-8f90-4ba8-94e7-e33e803bc906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:59.472175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38521a40-8f90-4ba8-94e7-e33e803bc906 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.472557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38521a40-8f90-4ba8-94e7-e33e803bc906 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.472835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38521a40-8f90-4ba8-94e7-e33e803bc906 None admin] PATH_INFO: `/v3/projects/159c16b029f94d2d8a928099d7e0ff73` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.475964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38521a40-8f90-4ba8-94e7-e33e803bc906 None admin] RBAC: Authorizing `identity:get_project(project_id=159c16b029f94d2d8a928099d7e0ff73)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:59.477548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38521a40-8f90-4ba8-94e7-e33e803bc906 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:59.479633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 215/429] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:24:59 2022] GET /identity/v3/projects/159c16b029f94d2d8a928099d7e0ff73 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:59.495042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38521a40-8f90-4ba8-94e7-e33e803bc906 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:59.529963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:59.535940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8c524-1bec-426d-a635-0405420bc4b3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:59.572529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df97bd-b236-4027-8507-cd5c73e916dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:59.573201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df97bd-b236-4027-8507-cd5c73e916dd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.573476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df97bd-b236-4027-8507-cd5c73e916dd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.573794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df97bd-b236-4027-8507-cd5c73e916dd None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.574914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df97bd-b236-4027-8507-cd5c73e916dd None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:59.576333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df97bd-b236-4027-8507-cd5c73e916dd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:59.578338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 215/430] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:59 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:59.579060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df97bd-b236-4027-8507-cd5c73e916dd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:59.634400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38521a40-8f90-4ba8-94e7-e33e803bc906 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:59.654765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:59.678063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776507a4-f13d-4b15-8439-30558bc2325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:59.678880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776507a4-f13d-4b15-8439-30558bc2325c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.679266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776507a4-f13d-4b15-8439-30558bc2325c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.679639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776507a4-f13d-4b15-8439-30558bc2325c None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.680969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776507a4-f13d-4b15-8439-30558bc2325c None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:59.682573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776507a4-f13d-4b15-8439-30558bc2325c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:59.689656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 216/431] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:24:59 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:59.693624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776507a4-f13d-4b15-8439-30558bc2325c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:59.706645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df97bd-b236-4027-8507-cd5c73e916dd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:59.756555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a3b4-5b01-4387-9722-2c7c6462b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:59.757835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a3b4-5b01-4387-9722-2c7c6462b830 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.758406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a3b4-5b01-4387-9722-2c7c6462b830 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.758881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a3b4-5b01-4387-9722-2c7c6462b830 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.779082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4a3b4-5b01-4387-9722-2c7c6462b830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-cbb4a3b4-5b01-4387-9722-2c7c6462b830 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:24:59.788765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:24:59.790188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:24:59.791003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 216/432] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:24:59.793544 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a3b4-5b01-4387-9722-2c7c6462b830 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:59.828218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:59.843860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776507a4-f13d-4b15-8439-30558bc2325c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:59.895617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:59.896441 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.896820 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.897194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.898104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] RBAC: Adding query filter params (group.id=04bb7c3b5def4a7583713653d20b693c, role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=159c16b029f94d2d8a928099d7e0ff73) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:59.898521 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:59.900135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:24:59.908410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 217/433] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:24:59 2022] GET /identity/v3/role_assignments?group.id=04bb7c3b5def4a7583713653d20b693c&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=9d32107ec65445988af384e49812cfa7 => generated 611 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:24:59.909750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:24:59.942573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a3b4-5b01-4387-9722-2c7c6462b830 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:24:59.972103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:24:59.988690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52940f-542e-45bf-9593-4659cd3e77f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:24:59.989387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52940f-542e-45bf-9593-4659cd3e77f9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:24:59.989700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52940f-542e-45bf-9593-4659cd3e77f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:24:59.989978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52940f-542e-45bf-9593-4659cd3e77f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:24:59.990728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52940f-542e-45bf-9593-4659cd3e77f9 None admin] RBAC: Adding query filter params (group.id=04bb7c3b5def4a7583713653d20b693c, role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=159c16b029f94d2d8a928099d7e0ff73) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:24:59.991038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52940f-542e-45bf-9593-4659cd3e77f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:24:59.992949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52940f-542e-45bf-9593-4659cd3e77f9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:00.000258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 217/434] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:24:59 2022] GET /identity/v3/role_assignments?group.id=04bb7c3b5def4a7583713653d20b693c&scope.project.id=159c16b029f94d2d8a928099d7e0ff73&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:00.001541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d464b-ca97-4e26-ad31-2218700ec575 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:00.001843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d464b-ca97-4e26-ad31-2218700ec575 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:00.002117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d464b-ca97-4e26-ad31-2218700ec575 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:00.007991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 218/435] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:00.009581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845484b-5147-4de5-9d0e-0808a7732ed6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:00.009981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845484b-5147-4de5-9d0e-0808a7732ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:00.010165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845484b-5147-4de5-9d0e-0808a7732ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:00.031119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b845484b-5147-4de5-9d0e-0808a7732ed6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:00.033127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b845484b-5147-4de5-9d0e-0808a7732ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:00.070553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb477fe7-11be-4da1-b383-3ebb6cc8e8fc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:00.127625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:00.128693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:00.129178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:00.129684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:00.129813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 219/436] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:00.130725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:00.131251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:00.131357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595788a9-0104-43be-88af-fbd1fbb6b471 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:00.131614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595788a9-0104-43be-88af-fbd1fbb6b471 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:00.131895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595788a9-0104-43be-88af-fbd1fbb6b471 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:00.133290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 220/437] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:00.137630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:00.139897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06741c-b437-4f3d-993a-dd7b0dffaf76 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:00.140449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06741c-b437-4f3d-993a-dd7b0dffaf76 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:00.140932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06741c-b437-4f3d-993a-dd7b0dffaf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:00.153089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 218/438] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:00.160042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:00.162728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ab06741c-b437-4f3d-993a-dd7b0dffaf76 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:00.164312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ab06741c-b437-4f3d-993a-dd7b0dffaf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:00.195240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:00.265311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 221/439] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:25:00.303175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2120f5-4202-49f3-aa50-96e737c919cd None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:00.343069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e483f4-4885-4517-a4c3-ad869e95fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:00.344559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e483f4-4885-4517-a4c3-ad869e95fa07 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:00.345983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e483f4-4885-4517-a4c3-ad869e95fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:00.346776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e483f4-4885-4517-a4c3-ad869e95fa07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:00.430311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e483f4-4885-4517-a4c3-ad869e95fa07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:00.431728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e483f4-4885-4517-a4c3-ad869e95fa07 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:00.458427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:00.466493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06741c-b437-4f3d-993a-dd7b0dffaf76 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:00.599788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:00.654015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 219/440] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:00.655207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e483f4-4885-4517-a4c3-ad869e95fa07 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:00.701343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06741c-b437-4f3d-993a-dd7b0dffaf76 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:00.775095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b24a4e-7759-49ed-b126-71b6f0d01f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:00.775671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b24a4e-7759-49ed-b126-71b6f0d01f56 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:00.775952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b24a4e-7759-49ed-b126-71b6f0d01f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:00.776226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b24a4e-7759-49ed-b126-71b6f0d01f56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:00.802832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b24a4e-7759-49ed-b126-71b6f0d01f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d8b24a4e-7759-49ed-b126-71b6f0d01f56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:00.808160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:00.809070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:25:00.809908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:00.814418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 222/441] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:25:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:00.815712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b24a4e-7759-49ed-b126-71b6f0d01f56 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:00.842087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e483f4-4885-4517-a4c3-ad869e95fa07 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:00.872579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:00.898225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db178a-acfe-4caf-a32c-23a017844fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:00.899245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db178a-acfe-4caf-a32c-23a017844fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:00.899680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db178a-acfe-4caf-a32c-23a017844fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:00.899951 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db178a-acfe-4caf-a32c-23a017844fd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:00.911462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db178a-acfe-4caf-a32c-23a017844fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-a3db178a-acfe-4caf-a32c-23a017844fd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:00.918079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:00.919135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:00.919928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:00.928639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 220/442] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:00.929629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db178a-acfe-4caf-a32c-23a017844fd6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:00.971488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b24a4e-7759-49ed-b126-71b6f0d01f56 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:00.979166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.006374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcea005-b27d-4d6b-8d43-05390df4e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.007004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea005-b27d-4d6b-8d43-05390df4e640 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.007278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea005-b27d-4d6b-8d43-05390df4e640 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.007622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcea005-b27d-4d6b-8d43-05390df4e640 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.008745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcea005-b27d-4d6b-8d43-05390df4e640 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.010132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcea005-b27d-4d6b-8d43-05390df4e640 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.011923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 223/443] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:25:00 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:01.012513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcea005-b27d-4d6b-8d43-05390df4e640 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.039749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db178a-acfe-4caf-a32c-23a017844fd6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.075019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.075622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.075902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.076170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.076828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:01.077126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.078542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.088021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 221/444] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:01.088828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.113822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcea005-b27d-4d6b-8d43-05390df4e640 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.135945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.149712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.150645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.150935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.151205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.151867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:01.152170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.153577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.162502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 224/445] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:01.163326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.195682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f43033-e0b5-4c57-8e60-562bdf1daa4b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.202954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.230982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f950b-11d2-49e2-826d-41496f5e52aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.231520 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f950b-11d2-49e2-826d-41496f5e52aa None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.231915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f950b-11d2-49e2-826d-41496f5e52aa None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.232194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f950b-11d2-49e2-826d-41496f5e52aa None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.233307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f950b-11d2-49e2-826d-41496f5e52aa None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.234787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f950b-11d2-49e2-826d-41496f5e52aa None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.236372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 222/446] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:01.237133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f950b-11d2-49e2-826d-41496f5e52aa None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.270813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef3c79-2b98-411d-9025-166b1369a0ea None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.306567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4ba9-4fab-4941-a033-1d7ec69640f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.307185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4ba9-4fab-4941-a033-1d7ec69640f4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.307459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4ba9-4fab-4941-a033-1d7ec69640f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.307728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4ba9-4fab-4941-a033-1d7ec69640f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.339682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f950b-11d2-49e2-826d-41496f5e52aa None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.350721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.376932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93030a1-cd5f-4fee-bcf3-e9f48d8e623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.377558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93030a1-cd5f-4fee-bcf3-e9f48d8e623a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.377839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93030a1-cd5f-4fee-bcf3-e9f48d8e623a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.378108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93030a1-cd5f-4fee-bcf3-e9f48d8e623a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.378197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e4ba9-4fab-4941-a033-1d7ec69640f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.379672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e4ba9-4fab-4941-a033-1d7ec69640f4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.414654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.445365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93030a1-cd5f-4fee-bcf3-e9f48d8e623a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.446859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93030a1-cd5f-4fee-bcf3-e9f48d8e623a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.481743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 225/447] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:01.482506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4ba9-4fab-4941-a033-1d7ec69640f4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.551517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 223/448] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:01.552271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93030a1-cd5f-4fee-bcf3-e9f48d8e623a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.568629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.589538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4ba9-4fab-4941-a033-1d7ec69640f4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.623423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.624038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.624318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.624593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.625317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] RBAC: Adding query filter params (group.id=04bb7c3b5def4a7583713653d20b693c, role.id=ee1e03b1c7fc49c59595ac9b72bea8ba, scope.project.id=c37a56c851e44bbdae9b44a245897c27) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:01.625662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.627622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.630686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.642318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 226/449] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/role_assignments?group.id=04bb7c3b5def4a7583713653d20b693c&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=ee1e03b1c7fc49c59595ac9b72bea8ba => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:01.642318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.671408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93030a1-cd5f-4fee-bcf3-e9f48d8e623a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.721426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a88b-ebfb-4f2a-ba54-817a5cdb9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.722370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a88b-ebfb-4f2a-ba54-817a5cdb9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.722793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a88b-ebfb-4f2a-ba54-817a5cdb9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.723211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89a88b-ebfb-4f2a-ba54-817a5cdb9ea8 None admin] PATH_INFO: `/v3/projects/c37a56c851e44bbdae9b44a245897c27` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.724605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89a88b-ebfb-4f2a-ba54-817a5cdb9ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=c37a56c851e44bbdae9b44a245897c27)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.726269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89a88b-ebfb-4f2a-ba54-817a5cdb9ea8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.728582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 224/450] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/projects/c37a56c851e44bbdae9b44a245897c27 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:01.734619 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a88b-ebfb-4f2a-ba54-817a5cdb9ea8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.774526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf50b-da3a-4a8a-9f98-257bb35a5b18 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.818623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558cc2f-a76a-4f62-bd66-93931d5a7dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.819305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558cc2f-a76a-4f62-bd66-93931d5a7dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.819789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558cc2f-a76a-4f62-bd66-93931d5a7dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.819789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558cc2f-a76a-4f62-bd66-93931d5a7dd1 None admin] PATH_INFO: `/v3/projects/55a504954dfa4713bb307e2b5ecea75a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.821584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558cc2f-a76a-4f62-bd66-93931d5a7dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=55a504954dfa4713bb307e2b5ecea75a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.824196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558cc2f-a76a-4f62-bd66-93931d5a7dd1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.825538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 227/451] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/projects/55a504954dfa4713bb307e2b5ecea75a => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:01.831497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558cc2f-a76a-4f62-bd66-93931d5a7dd1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.838511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.871214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89a88b-ebfb-4f2a-ba54-817a5cdb9ea8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:01.910529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c76913-838e-4682-9c55-904647d786b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:01.911194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76913-838e-4682-9c55-904647d786b8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:01.911480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76913-838e-4682-9c55-904647d786b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:01.911760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c76913-838e-4682-9c55-904647d786b8 None admin] PATH_INFO: `/v3/groups/04bb7c3b5def4a7583713653d20b693c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:01.912918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c76913-838e-4682-9c55-904647d786b8 None admin] RBAC: Authorizing `identity:get_group(group_id=04bb7c3b5def4a7583713653d20b693c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:01.914416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c76913-838e-4682-9c55-904647d786b8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:01.916163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 225/452] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/groups/04bb7c3b5def4a7583713653d20b693c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:01.921201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:01.922397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c76913-838e-4682-9c55-904647d786b8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:01.966038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558cc2f-a76a-4f62-bd66-93931d5a7dd1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:02.007888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d0c3-ee5b-43d2-8915-58af97c8a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:02.008496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d0c3-ee5b-43d2-8915-58af97c8a038 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:02.008736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d0c3-ee5b-43d2-8915-58af97c8a038 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:02.009009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1d0c3-ee5b-43d2-8915-58af97c8a038 None admin] PATH_INFO: `/v3/groups/30c0fcdb12744a0398b92b7c8c230d64` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:02.010271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1d0c3-ee5b-43d2-8915-58af97c8a038 None admin] RBAC: Authorizing `identity:get_group(group_id=30c0fcdb12744a0398b92b7c8c230d64)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:02.011728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1d0c3-ee5b-43d2-8915-58af97c8a038 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:02.013564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 228/453] 10.222.0.17 () {56 vars in 1180 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/groups/30c0fcdb12744a0398b92b7c8c230d64 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:02.019240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d0c3-ee5b-43d2-8915-58af97c8a038 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:02.039853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c76913-838e-4682-9c55-904647d786b8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:02.078690 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9baa7-1f2c-41de-a433-5201213feae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:02.079661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9baa7-1f2c-41de-a433-5201213feae3 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:02.080091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9baa7-1f2c-41de-a433-5201213feae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:02.080506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9baa7-1f2c-41de-a433-5201213feae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:02.081728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9baa7-1f2c-41de-a433-5201213feae3 None admin] RBAC: Adding query filter params (group.id=04bb7c3b5def4a7583713653d20b693c, role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=c37a56c851e44bbdae9b44a245897c27) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:02.082222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9baa7-1f2c-41de-a433-5201213feae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:02.084502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9baa7-1f2c-41de-a433-5201213feae3 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:02.093554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 226/454] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:25:01 2022] GET /identity/v3/role_assignments?group.id=04bb7c3b5def4a7583713653d20b693c&scope.project.id=c37a56c851e44bbdae9b44a245897c27&role.id=9d32107ec65445988af384e49812cfa7 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:02.142367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1d0c3-ee5b-43d2-8915-58af97c8a038 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:02.181999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ad63f-235a-4ef8-a8c9-832f9927ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:02.182629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ad63f-235a-4ef8-a8c9-832f9927ec7a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:02.182913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ad63f-235a-4ef8-a8c9-832f9927ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:02.183191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ad63f-235a-4ef8-a8c9-832f9927ec7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:02.183937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ad63f-235a-4ef8-a8c9-832f9927ec7a None admin] RBAC: Adding query filter params (group.id=30c0fcdb12744a0398b92b7c8c230d64, role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=55a504954dfa4713bb307e2b5ecea75a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:02.184246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ad63f-235a-4ef8-a8c9-832f9927ec7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:02.185886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ad63f-235a-4ef8-a8c9-832f9927ec7a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:02.189163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:02.192847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 229/455] 10.222.0.17 () {56 vars in 1376 bytes} [Mon Oct 3 12:25:02 2022] GET /identity/v3/role_assignments?group.id=30c0fcdb12744a0398b92b7c8c230d64&scope.project.id=55a504954dfa4713bb307e2b5ecea75a&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:04.976643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419155a5-2eb0-44a6-87ba-6d3650cf1c98 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:04.977687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419155a5-2eb0-44a6-87ba-6d3650cf1c98 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:04.978231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419155a5-2eb0-44a6-87ba-6d3650cf1c98 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:04.980005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 227/456] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:04.986847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0f423-6715-47d7-be8a-bf684521fffb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:04.987362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0f423-6715-47d7-be8a-bf684521fffb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:04.987362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0f423-6715-47d7-be8a-bf684521fffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:05.015055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c0e0f423-6715-47d7-be8a-bf684521fffb None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:05.016300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c0e0f423-6715-47d7-be8a-bf684521fffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:05.082645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45e74-17bf-4a57-8db3-751755cad287 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:05.083296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45e74-17bf-4a57-8db3-751755cad287 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:05.083773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45e74-17bf-4a57-8db3-751755cad287 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:05.085650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 228/457] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:05.090885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c7fad-93f2-490c-b72e-689b2cc0e901 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:05.091524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c7fad-93f2-490c-b72e-689b2cc0e901 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:05.091999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c7fad-93f2-490c-b72e-689b2cc0e901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:05.101558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 230/458] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:05.129799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-0b5c7fad-93f2-490c-b72e-689b2cc0e901 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:05.131413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0b5c7fad-93f2-490c-b72e-689b2cc0e901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:05.134865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:05.224653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 229/459] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:05.417008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191ce2-1203-4166-bcdd-80ff441261a5 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:05.417745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191ce2-1203-4166-bcdd-80ff441261a5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:05.418247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191ce2-1203-4166-bcdd-80ff441261a5 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:05.420091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 231/460] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:05.426925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6fbd-3b35-487b-a2b0-cb82dec37ca9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:05.427536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6fbd-3b35-487b-a2b0-cb82dec37ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:05.428016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b6fbd-3b35-487b-a2b0-cb82dec37ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:05.447736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-864b6fbd-3b35-487b-a2b0-cb82dec37ca9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:05.449257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-864b6fbd-3b35-487b-a2b0-cb82dec37ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:05.521255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 230/461] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:25:05.544680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191ce2-1203-4166-bcdd-80ff441261a5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:05.593229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b6fbd-3b35-487b-a2b0-cb82dec37ca9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:05.671384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191ce2-1203-4166-bcdd-80ff441261a5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:05.703047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:05.710214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:05.711214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:05.712005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:05.712463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:05.725331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:05.727256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:05.744686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:05.745697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:05.746560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:05.746560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:05.746560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:05.748824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 232/462] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:05.757898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:05.768019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:05.793093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b6fbd-3b35-487b-a2b0-cb82dec37ca9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:05.847923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:05.848723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:05.849075 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:05.849475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:05.867253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:05.871147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:05.893055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:05.894073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:05.894947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:05.894947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:05.894947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:05.895670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 231/463] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:05.897378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:05.918876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a590-1ecf-4639-980a-8805751b0df4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:05.963359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:05.963897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:05.964317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:05.964594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:05.965245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:05.965574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:05.966980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:05.984647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 233/464] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:05.984647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:06.021452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ba3f6-f1b7-4609-82aa-905bbdea4d17 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:06.038382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:06.044878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:06.058213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11ed9-663d-4268-9d8d-f8087c4945e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:06.058832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11ed9-663d-4268-9d8d-f8087c4945e2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.059110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11ed9-663d-4268-9d8d-f8087c4945e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.059383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11ed9-663d-4268-9d8d-f8087c4945e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.071546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc11ed9-663d-4268-9d8d-f8087c4945e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:06.073032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc11ed9-663d-4268-9d8d-f8087c4945e2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-0bc11ed9-663d-4268-9d8d-f8087c4945e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:06.088413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:06.089391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:06.090255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:06.090255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:06.090255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:06.090255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 232/465] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:06.090835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5441-12ca-4382-a8fe-b51599976e0b None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.091115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5441-12ca-4382-a8fe-b51599976e0b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.091392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d5441-12ca-4382-a8fe-b51599976e0b None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.092810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 233/466] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:06.093350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5441-12ca-4382-a8fe-b51599976e0b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:06.122045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912b7b4-11ac-423f-86ac-65ff8c02a821 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:06.167820 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:06.169231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.169845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.170423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.171390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:06.171875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:06.174292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:06.190213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 234/467] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:06.192030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:06.205987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d5441-12ca-4382-a8fe-b51599976e0b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:06.246696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ed8b4-b755-43ba-9502-3c2553a9733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:06.247217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ed8b4-b755-43ba-9502-3c2553a9733a None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.247496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ed8b4-b755-43ba-9502-3c2553a9733a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.247772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ed8b4-b755-43ba-9502-3c2553a9733a None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.248424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ed8b4-b755-43ba-9502-3c2553a9733a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:06.249940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ed8b4-b755-43ba-9502-3c2553a9733a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:06.275044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 234/468] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:25:06 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:06.276604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed186-954a-4f92-b2c9-621ac0d49fa0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.277110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed186-954a-4f92-b2c9-621ac0d49fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.277612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed186-954a-4f92-b2c9-621ac0d49fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.299259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-be4ed186-954a-4f92-b2c9-621ac0d49fa0 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:06.300827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-be4ed186-954a-4f92-b2c9-621ac0d49fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:06.330310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:06.339717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9cfe5-5a58-40f7-ae7d-66c027e68cb7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:06.342209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:06.394157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 235/469] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:06.395840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed186-954a-4f92-b2c9-621ac0d49fa0 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:06.397457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:06.398148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.398434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.398717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.403059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:06.403059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:06.403059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:06.417255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 235/470] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:06.423980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:06.544697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041f698-c0d5-4174-8df7-486b2a139dcb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:06.584962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2a8aa-c1d0-4b64-b157-d2f046ef3e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:06.585645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a8aa-c1d0-4b64-b157-d2f046ef3e12 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.585932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a8aa-c1d0-4b64-b157-d2f046ef3e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.586208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2a8aa-c1d0-4b64-b157-d2f046ef3e12 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.586603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed186-954a-4f92-b2c9-621ac0d49fa0 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:06.586886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2a8aa-c1d0-4b64-b157-d2f046ef3e12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:06.588398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2a8aa-c1d0-4b64-b157-d2f046ef3e12 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:06.621713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 236/471] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:25:06 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:06.668349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b6e2-3c8f-485a-b1b5-e4e503f706ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:06.669073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b6e2-3c8f-485a-b1b5-e4e503f706ce None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.669383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b6e2-3c8f-485a-b1b5-e4e503f706ce None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.669715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b6e2-3c8f-485a-b1b5-e4e503f706ce None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.670704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1b6e2-3c8f-485a-b1b5-e4e503f706ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:06.673316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1b6e2-3c8f-485a-b1b5-e4e503f706ce None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:06.705038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 236/472] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:25:06 2022] POST /identity/v3/users => generated 246 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:06.724625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a877-99fd-4c67-ac73-26d15101d416 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.724914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a877-99fd-4c67-ac73-26d15101d416 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.725194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a877-99fd-4c67-ac73-26d15101d416 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.727019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 237/473] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:06.733190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20486a0a-8c8b-45fe-a445-9e5f13ee52e5 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.733577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20486a0a-8c8b-45fe-a445-9e5f13ee52e5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.733863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20486a0a-8c8b-45fe-a445-9e5f13ee52e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.750958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a877-99fd-4c67-ac73-26d15101d416 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:06.765728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-20486a0a-8c8b-45fe-a445-9e5f13ee52e5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:06.767032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-20486a0a-8c8b-45fe-a445-9e5f13ee52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:06.777662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:06.783780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:06.903813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 237/474] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:06.938311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a877-99fd-4c67-ac73-26d15101d416 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:06.980202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:06.980860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:06.981139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:06.981413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:06.994674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:06.996216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:07.012411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:07.013376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:07.014253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:07.014253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:07.014253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:07.014253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 238/475] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:07.022083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20486a0a-8c8b-45fe-a445-9e5f13ee52e5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:07.136867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20486a0a-8c8b-45fe-a445-9e5f13ee52e5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:07.174897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:07.175443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:07.175724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:07.175999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:07.176665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:07.177033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:07.178605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:07.199514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 238/476] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:07.201697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:07.207371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:07.223327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:07.373473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:07.375857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bfc2-2ff0-4095-8c09-6a1d16425eaa None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:07.428666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb085-c109-4f8e-8b36-b86109c6793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:07.429204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb085-c109-4f8e-8b36-b86109c6793e None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:07.429486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb085-c109-4f8e-8b36-b86109c6793e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:07.429784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb085-c109-4f8e-8b36-b86109c6793e None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:07.431268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb085-c109-4f8e-8b36-b86109c6793e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:07.432752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb085-c109-4f8e-8b36-b86109c6793e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:07.441531 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922b514-c581-4e19-ad38-31567d1394db None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:07.475701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 239/477] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:25:07 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:25:07.496082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:07.496728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:07.497009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:07.497282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:07.498025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:07.499472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:07.511094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.sql.core [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 12:25:07.511094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 03 12:25:07.511094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [parameters: {'id': '9bd95a001c3c4b958a79d13d3aa06f17', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 03 12:25:07.511094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application conn.query(q) Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result.read() Oct 03 12:25:07.529798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return ref.to_dict() Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 12:25:07.530731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application next(self.gen) Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application yield resource Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application next(self.gen) Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise self.value Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application session.commit() Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 12:25:07.531669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.session.flush() Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application compat.raise_( Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 12:25:07.532532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 12:25:07.533407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application conn.query(q) Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application result.read() Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 12:25:07.534231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [parameters: {'id': '9bd95a001c3c4b958a79d13d3aa06f17', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:07.535005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 03 12:25:07.535861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:07.536712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 239/478] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Oct 3 12:25:07 2022] POST /identity/v3/roles => generated 144 bytes in 330 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:07.538181 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb085-c109-4f8e-8b36-b86109c6793e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:07.661285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:07.726250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb085-c109-4f8e-8b36-b86109c6793e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:07.765992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfda01-6145-47be-b691-0d9d34f96160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:07.767048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfda01-6145-47be-b691-0d9d34f96160 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:07.767568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfda01-6145-47be-b691-0d9d34f96160 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:07.768053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfda01-6145-47be-b691-0d9d34f96160 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:07.779411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfda01-6145-47be-b691-0d9d34f96160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-51bfda01-6145-47be-b691-0d9d34f96160 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:07.785123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:07.786028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 03 12:25:07.786854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:07.789427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 240/479] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:07.795642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:07.945137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aafa1-12d5-4823-aaf0-d02cc76aac62 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:07.989727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72dd19c-df9d-42f1-9681-e240de3ffa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:07.990353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd19c-df9d-42f1-9681-e240de3ffa86 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:07.990636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd19c-df9d-42f1-9681-e240de3ffa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:07.990913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72dd19c-df9d-42f1-9681-e240de3ffa86 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:07.991848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dd19c-df9d-42f1-9681-e240de3ffa86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:07.992163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dd19c-df9d-42f1-9681-e240de3ffa86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:07.993644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72dd19c-df9d-42f1-9681-e240de3ffa86 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:08.004589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 240/480] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:08.009994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:09.184719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602718-f3f2-4019-b807-e8c004a8cf19 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:09.185248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602718-f3f2-4019-b807-e8c004a8cf19 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:09.185248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602718-f3f2-4019-b807-e8c004a8cf19 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:09.187082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 241/481] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:09.193480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3235-ec0e-443c-9eda-440904be2a72 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:09.194008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3235-ec0e-443c-9eda-440904be2a72 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:09.194085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd3235-ec0e-443c-9eda-440904be2a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:09.215818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9bfd3235-ec0e-443c-9eda-440904be2a72 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:09.217075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9bfd3235-ec0e-443c-9eda-440904be2a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:09.281819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2101d3-9be6-450c-ac12-e15400cdbdbc None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:09.282168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2101d3-9be6-450c-ac12-e15400cdbdbc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:09.282368 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2101d3-9be6-450c-ac12-e15400cdbdbc None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:09.283998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 242/482] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:09.289376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3d37-76c4-4c8d-a31e-28d6c6a1b146 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:09.289703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3d37-76c4-4c8d-a31e-28d6c6a1b146 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:09.289984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3d37-76c4-4c8d-a31e-28d6c6a1b146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:09.312337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8f5f3d37-76c4-4c8d-a31e-28d6c6a1b146 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:09.316269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8f5f3d37-76c4-4c8d-a31e-28d6c6a1b146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:09.322111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 241/483] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:09.413911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 243/484] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:25:09.581207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a4bbd-e907-4208-91b6-47517452ad10 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:09.581390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a4bbd-e907-4208-91b6-47517452ad10 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:09.581727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a4bbd-e907-4208-91b6-47517452ad10 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:09.583327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 242/485] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:09.602512 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619608-d67d-4495-9ab0-ad1980909358 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:09.602935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619608-d67d-4495-9ab0-ad1980909358 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:09.603347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c619608-d67d-4495-9ab0-ad1980909358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:09.634629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2c619608-d67d-4495-9ab0-ad1980909358 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:09.635918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2c619608-d67d-4495-9ab0-ad1980909358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:09.705127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:09.735645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 244/486] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:09.789879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a4bbd-e907-4208-91b6-47517452ad10 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:09.797019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619608-d67d-4495-9ab0-ad1980909358 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:09.937178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c619608-d67d-4495-9ab0-ad1980909358 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:09.959000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a4bbd-e907-4208-91b6-47517452ad10 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.001647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:10.004552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42882eca-af60-4839-9419-0a2e2a565980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.005209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42882eca-af60-4839-9419-0a2e2a565980 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.005494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42882eca-af60-4839-9419-0a2e2a565980 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.005798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42882eca-af60-4839-9419-0a2e2a565980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.019283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a800-5f41-445a-80ea-f292e0de3e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.019956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a800-5f41-445a-80ea-f292e0de3e98 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.020234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a800-5f41-445a-80ea-f292e0de3e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.020502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621a800-5f41-445a-80ea-f292e0de3e98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.034032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42882eca-af60-4839-9419-0a2e2a565980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-42882eca-af60-4839-9419-0a2e2a565980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:10.039246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:10.040950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:10.042097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:10.049508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621a800-5f41-445a-80ea-f292e0de3e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:10.049819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 245/487] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:10.050526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42882eca-af60-4839-9419-0a2e2a565980 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1621a800-5f41-445a-80ea-f292e0de3e98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:10.053679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:10.056052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:10.057981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 243/488] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:10.065359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a800-5f41-445a-80ea-f292e0de3e98 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.142117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:10.225069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42882eca-af60-4839-9419-0a2e2a565980 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.226337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621a800-5f41-445a-80ea-f292e0de3e98 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.276244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.276736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.277309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.277422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.277656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.277938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.278209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.278613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.278727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:10.278988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:10.279648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:10.280103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:10.280370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:10.282623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:10.291620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 244/489] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:10.291620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.298496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 246/490] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:10.299720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.362926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:10.444779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491674d-8f62-4e73-9874-b5507934ba97 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.477841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08963-dcac-4887-8491-64fe37f0bd13 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.481412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:10.495218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631d726-f00c-4fcc-b187-05e30558d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.496453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d726-f00c-4fcc-b187-05e30558d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.496954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d726-f00c-4fcc-b187-05e30558d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.497507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631d726-f00c-4fcc-b187-05e30558d4c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.512644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631d726-f00c-4fcc-b187-05e30558d4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5631d726-f00c-4fcc-b187-05e30558d4c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:10.519677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:10.520884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:10.521920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:10.528842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.528842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.528842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.528842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.529646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 245/491] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:10.532048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631d726-f00c-4fcc-b187-05e30558d4c7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.542044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:10.543890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:10.561274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:10.562346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:10.564020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:10.564020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:10.564020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:10.564020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 247/492] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:10.564020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.686157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03b231-035c-49c2-acc0-ead568247a3c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.695936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631d726-f00c-4fcc-b187-05e30558d4c7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.708998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:10.742175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5867c-3c7f-4e85-81c6-a3c76cbb130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.742742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5867c-3c7f-4e85-81c6-a3c76cbb130a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.743024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5867c-3c7f-4e85-81c6-a3c76cbb130a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.743300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5867c-3c7f-4e85-81c6-a3c76cbb130a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.752764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.753690 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.754192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.754682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.755913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:10.756456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:10.757222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5867c-3c7f-4e85-81c6-a3c76cbb130a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:10.758967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5867c-3c7f-4e85-81c6-a3c76cbb130a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:10.759187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:10.774783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 248/493] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:10.776402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-2ff5867c-3c7f-4e85-81c6-a3c76cbb130a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:10.778388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:10.779511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:10.783451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:10.783451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:10.783451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:10.783451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 246/494] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:10.783451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6af5d7-953b-470c-b481-83e31794b0a6 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.783451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6af5d7-953b-470c-b481-83e31794b0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.783451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6af5d7-953b-470c-b481-83e31794b0a6 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.783451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 247/495] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:10.784494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6af5d7-953b-470c-b481-83e31794b0a6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.814968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:10.920214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d38ca4-4312-4071-a789-f7c4cfb2c127 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.920703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6af5d7-953b-470c-b481-83e31794b0a6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:10.959375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.959652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c54476-0fb0-4c8c-9d52-03c90ee5ddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:10.960000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.960271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54476-0fb0-4c8c-9d52-03c90ee5ddb6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:10.960369 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.960530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.960620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54476-0fb0-4c8c-9d52-03c90ee5ddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:10.960815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54476-0fb0-4c8c-9d52-03c90ee5ddb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:10.961188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:10.961491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:10.962943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:10.974819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c54476-0fb0-4c8c-9d52-03c90ee5ddb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:10.976285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c54476-0fb0-4c8c-9d52-03c90ee5ddb6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:10.981620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 249/496] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:10.981620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-13c54476-0fb0-4c8c-9d52-03c90ee5ddb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:10.997708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:10.998672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:10.999560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:10.999560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:10.999560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:10.999560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 248/497] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:11.000246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fef01-c86e-41f3-8302-9024eaad9973 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.000346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fef01-c86e-41f3-8302-9024eaad9973 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.000606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fef01-c86e-41f3-8302-9024eaad9973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.020995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1e6fef01-c86e-41f3-8302-9024eaad9973 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:11.022244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1e6fef01-c86e-41f3-8302-9024eaad9973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:11.030296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:11.069252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:11.092272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a8aa2-c3a7-418e-b09b-c8dc8f2986fe None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.105703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 249/498] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:11.105703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fef01-c86e-41f3-8302-9024eaad9973 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.144924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.145561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.145901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.146111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.146745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:11.147051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:11.148445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:11.161660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 250/499] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:11.162498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.210063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fef01-c86e-41f3-8302-9024eaad9973 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.246050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734abd86-ec13-43bc-9dac-1c9a1afcbb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.246735 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734abd86-ec13-43bc-9dac-1c9a1afcbb28 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.246953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734abd86-ec13-43bc-9dac-1c9a1afcbb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.247235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734abd86-ec13-43bc-9dac-1c9a1afcbb28 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.255357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734abd86-ec13-43bc-9dac-1c9a1afcbb28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:11.256757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734abd86-ec13-43bc-9dac-1c9a1afcbb28 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:11.270149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64090995-7406-4c35-a97a-0e7508c17c00 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-734abd86-ec13-43bc-9dac-1c9a1afcbb28 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:11.270677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:11.271499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:11.272397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 250/500] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:11.272971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5aa2b-d512-4071-80c7-9d25053d31e0 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.273377 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5aa2b-d512-4071-80c7-9d25053d31e0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.273377 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5aa2b-d512-4071-80c7-9d25053d31e0 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.278896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 251/501] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:11.278896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5aa2b-d512-4071-80c7-9d25053d31e0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.279432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:11.315224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.316154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.316583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.317009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.317695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:11.318002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:11.319479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:11.327481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:11.338398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 251/502] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:11.338398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.395249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5aa2b-d512-4071-80c7-9d25053d31e0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.429903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fbbaf-9814-4c7f-9a1a-f94c812e498e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.430798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fbbaf-9814-4c7f-9a1a-f94c812e498e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.431075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fbbaf-9814-4c7f-9a1a-f94c812e498e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.431369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fbbaf-9814-4c7f-9a1a-f94c812e498e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.439979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caacd1d-2de1-459f-82f2-763162dffba4 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.440528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fbbaf-9814-4c7f-9a1a-f94c812e498e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:11.442150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fbbaf-9814-4c7f-9a1a-f94c812e498e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-4f4fbbaf-9814-4c7f-9a1a-f94c812e498e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:11.454032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:11.454971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:11.455875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 252/503] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:11.456446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c6c9-ba71-43f8-bf72-53079a91c578 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.456783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c6c9-ba71-43f8-bf72-53079a91c578 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.457010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c6c9-ba71-43f8-bf72-53079a91c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.475784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-13e3c6c9-ba71-43f8-bf72-53079a91c578 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:11.476991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-13e3c6c9-ba71-43f8-bf72-53079a91c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:11.480107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.480707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.480991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.481266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.482025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:11.482341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:11.483770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:11.522359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 252/504] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:11.523122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.539049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:11.565653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 253/505] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:11.565653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3c6c9-ba71-43f8-bf72-53079a91c578 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.583643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:11.632276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58613f6-1132-4d26-8b8d-0864b13fbcd7 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.671539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.672872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.673139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.673415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.674659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3c6c9-ba71-43f8-bf72-53079a91c578 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.682223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:11.683770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:11.706046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:11.707004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:11.707887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 253/506] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:11.708450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.732315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3703-2a5b-4965-869a-14a238d381b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.733002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3703-2a5b-4965-869a-14a238d381b0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.733372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3703-2a5b-4965-869a-14a238d381b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.733778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3703-2a5b-4965-869a-14a238d381b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.747270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3703-2a5b-4965-869a-14a238d381b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ccdb3703-2a5b-4965-869a-14a238d381b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:11.752970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:11.753949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:11.754787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 254/507] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:11.755509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3703-2a5b-4965-869a-14a238d381b0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.819918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:11.840270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061e5e5-08bf-45cd-b940-6224d351ec5f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.857248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:11.869140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3703-2a5b-4965-869a-14a238d381b0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:11.877360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.878045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.878483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.878757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.879490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:11.879793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:11.881267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:11.900439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 254/508] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:11.901546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:11.904978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555422c-638f-42b1-ae85-aa9a42ac1eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:11.905706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555422c-638f-42b1-ae85-aa9a42ac1eac None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:11.906690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555422c-638f-42b1-ae85-aa9a42ac1eac None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:11.906812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555422c-638f-42b1-ae85-aa9a42ac1eac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:11.975432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555422c-638f-42b1-ae85-aa9a42ac1eac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:11.976878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555422c-638f-42b1-ae85-aa9a42ac1eac None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.002963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa316b8-d986-4502-9105-7736a73b7201 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.029135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.040949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.041585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.041871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.042148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.042877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:12.043187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.044653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.062888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 255/509] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:12.063720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.083390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 255/510] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:12.084165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555422c-638f-42b1-ae85-aa9a42ac1eac None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.097800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.167707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c9bc7-54e7-412b-a9a3-709a036a05e5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.186745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555422c-638f-42b1-ae85-aa9a42ac1eac None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.204377 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.204987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.205272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.205587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.206249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:12.206559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.207996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.216233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 256/511] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:12.217041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.227127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.227763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.228049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.228322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.238930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.240367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:12.255570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:12.256939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:12.257831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:12.257831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:12.257831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:12.257831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 256/512] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:12.257831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.261384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.316109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.323444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa40ac-52b1-423d-99dd-dbc668bdedd3 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.358169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e258ce-8ba8-499e-9463-9f69df4c4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.358687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e258ce-8ba8-499e-9463-9f69df4c4968 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.358966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e258ce-8ba8-499e-9463-9f69df4c4968 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.359274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e258ce-8ba8-499e-9463-9f69df4c4968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.365960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b5d22-8a23-4ab3-a06b-1b0851948adb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.408881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb183-c3b0-4824-8745-5633577202e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.409496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb183-c3b0-4824-8745-5633577202e1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.409803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb183-c3b0-4824-8745-5633577202e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.410077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb183-c3b0-4824-8745-5633577202e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.427447 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e258ce-8ba8-499e-9463-9f69df4c4968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.429091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e258ce-8ba8-499e-9463-9f69df4c4968 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.479012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb183-c3b0-4824-8745-5633577202e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.480469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb183-c3b0-4824-8745-5633577202e1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.483127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.520499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.528404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 257/513] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:12.529114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e258ce-8ba8-499e-9463-9f69df4c4968 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.583215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 257/514] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:12.583838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb183-c3b0-4824-8745-5633577202e1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.628457 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e258ce-8ba8-499e-9463-9f69df4c4968 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.663503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.664130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.664459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.664683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.674779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.676357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.684275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb183-c3b0-4824-8745-5633577202e1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.686602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:12.691692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:12.692720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:12.694496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:12.694496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:12.694496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:12.694496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 258/515] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:12.694496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.725214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.726103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.726838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.727122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.738422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.739967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.748604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:12.756514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:12.757763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:12.758653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:12.758653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:12.758653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:12.758653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 258/516] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:12.758872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.807638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6c355-b678-4152-8205-08230329dfcb None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.842232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.842842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.843127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.843402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.844119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:12.844429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.845847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.857871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 259/517] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:12.858709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.866447 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71a537-f755-41ea-af50-53a62a81054d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.901853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:12.902404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:12.902684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:12.902964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:12.916409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:12.918073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:12.933912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:12.935154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:12.935990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:12.935990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:12.935990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:12.935990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 259/518] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:12.935990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:12.949378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:12.978449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7c192-b57e-4578-8533-3f229aa859df None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:12.987572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:13.016348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.016987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.017271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.017573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.028153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.029647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:13.044354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:13.045452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:13.046386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:13.046386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:13.046386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:13.046386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 260/519] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:13.046386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.047221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e1ff6-0668-4f5c-98be-35959135b02d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.082950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.083559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.083835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.084221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.084745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:13.085049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.086553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.098585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 260/520] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:13.099404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.153867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab767e-0ce8-4a90-929a-13af28b66a84 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.170264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:13.188544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.189148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.189432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.189740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.190385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:13.190735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.192092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.204173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 261/521] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:13.205010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.208405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2d366-d43d-4735-b293-e75c2ca0f168 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.223455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:13.244471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ca08-0bab-4f59-8bb1-af4a93f37235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.245106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ca08-0bab-4f59-8bb1-af4a93f37235 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.245387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ca08-0bab-4f59-8bb1-af4a93f37235 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.245693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ca08-0bab-4f59-8bb1-af4a93f37235 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.246347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6ca08-0bab-4f59-8bb1-af4a93f37235 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.247775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6ca08-0bab-4f59-8bb1-af4a93f37235 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.270933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 261/522] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:25:13 2022] POST /identity/v3/users => generated 247 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:13.271861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ca08-0bab-4f59-8bb1-af4a93f37235 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.323845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55574854-8d2f-4890-940f-391bbeb2fac3 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.378665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.379729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.380255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.380935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.381741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:13.382056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.383522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.396800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ca08-0bab-4f59-8bb1-af4a93f37235 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.397498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 262/523] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:13.398412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.434788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:13.452049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.452705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.453504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.453641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.454577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:13.454890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.456845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.476787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 262/524] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:13.477104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.501114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:13.541180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483776a-b18b-4d2d-a127-edad8e97d419 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.584444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.585466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.585466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.585680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.596099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.598156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.615145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a8495-f8c9-4400-bb70-49eace19e8b9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:13.616238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:13.617222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 263/525] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:13.623948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.655657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.657111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.657111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.657426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.666623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.667744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:13.680852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:13.682226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 263/526] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:13.683321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.751097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:13.772961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf365c7-3d1f-45da-94f5-5304b1b536a8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.812764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.813465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.813789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.814096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.823184 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.824659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.826166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097df9c2-19c5-46e6-933e-48b8cf9290e1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:13.826669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:13.848259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:13.849185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:13.850182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 264/527] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:13.850654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.878567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:13.879696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:13.880392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:13.881373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:13.894995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:13.897851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:13.921027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:13.922426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:13.923387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 264/528] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:13.924803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:13.977329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af7360-3cee-4295-8d97-6ea00b0c6aaa None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:14.012872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:14.013483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:14.013805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:14.014076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:14.014779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:14.015084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:14.017067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:14.044687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 265/529] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:14.044687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:14.071693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce7fdb-7fda-4ad1-bbd4-3f3b252c46bc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:14.075079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:14.110459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:14.111933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:14.112625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:14.112989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:14.113268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:14.114119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:14.114437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:14.116140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:14.157536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 265/530] 10.222.0.17 () {56 vars in 1139 bytes} [Mon Oct 3 12:25:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:14.158426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:14.167355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1637-510f-486b-ba16-e147a6e8a387 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:14.212904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:14.212904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:14.213194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:14.213418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:14.214195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:14.214505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:14.216043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:14.236997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 266/531] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:14.237855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:14.300160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefe535-e5f3-4176-b7dd-03200767d282 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:14.343236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:14.344488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:14.344777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:14.345054 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:14.345988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:14.346190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:14.347641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:14.376579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 266/532] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:14.376579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:14.393168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a20a4d-997e-4d3a-a60e-fc32f62fbd31 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:14.405372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:14.429162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:14.462983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:14.463982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:14.464503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:14.464955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:14.466323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=d676c76b05924c4ab06940f04996fa3f) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:14.466867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:14.469767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:14.489646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 267/533] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:14 2022] GET /identity/v3/role_assignments?user.id=d676c76b05924c4ab06940f04996fa3f&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:14.489646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:14.531102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390523f-6fcd-49bd-b249-f604aa574ede None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:14.593015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38bf1-7822-4697-b0db-3abab6d5ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:14.594142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38bf1-7822-4697-b0db-3abab6d5ee26 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:14.594642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38bf1-7822-4697-b0db-3abab6d5ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:14.595197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38bf1-7822-4697-b0db-3abab6d5ee26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:14.629950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b12db6-6607-48f7-b8ec-0ddf2995dc7e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:14.670169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:14.670884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:14.671168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:14.671986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:14.672966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=1e81eb41d8264474917e3b4f3fa2becd) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:14.673283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:14.674831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:14.682626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 268/534] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:14 2022] GET /identity/v3/role_assignments?user.id=1e81eb41d8264474917e3b4f3fa2becd&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:14.683573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:14.740169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38bf1-7822-4697-b0db-3abab6d5ee26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:14.742920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38bf1-7822-4697-b0db-3abab6d5ee26 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:14.778827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:14.791929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:14.901945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 267/535] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:14.909479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38bf1-7822-4697-b0db-3abab6d5ee26 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:14.935230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8d35-b6a0-494d-af08-6facc2fb2daa None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:15.007906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:15.008446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:15.008724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:15.008996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:15.009776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=589b89539f8d43e993201fab13cd443a) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:15.010092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:15.011551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:15.026639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 269/536] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:14 2022] GET /identity/v3/role_assignments?user.id=589b89539f8d43e993201fab13cd443a&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:15.081397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38bf1-7822-4697-b0db-3abab6d5ee26 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:15.109576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:15.133809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:15.134480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:15.134764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:15.135044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:15.147188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:15.148706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:15.166751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:15.167998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:15.169131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:15.169131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:15.169131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:15.169131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 268/537] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:15.174344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:15.365123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aec0e2-1af6-4a7f-9189-2a37b325075f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:15.396694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:15.445843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:15.446960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:15.447445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:15.447898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:15.449143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:15.449766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:15.452367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:15.482408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 270/538] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:15.490516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:15.685390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf837c-3521-443d-abae-d8298577e5e8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:15.739489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:15.740149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:15.740483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:15.741078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:15.751459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:15.754054 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:15.771945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:15.772872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:15.774226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 269/539] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:15.782109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:15.954035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd42fe-d7f8-4559-a21e-911647dc5eb8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:16.042243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32922d-1735-4c91-8922-4b5221b24459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:16.043268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32922d-1735-4c91-8922-4b5221b24459 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:16.043762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32922d-1735-4c91-8922-4b5221b24459 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:16.044258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32922d-1735-4c91-8922-4b5221b24459 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:16.045591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32922d-1735-4c91-8922-4b5221b24459 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:16.046143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32922d-1735-4c91-8922-4b5221b24459 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:16.048556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32922d-1735-4c91-8922-4b5221b24459 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:16.069231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 271/540] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:16.074875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:16.124178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d059-f222-44e5-b41d-95fb6dda9947 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:16.124781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d059-f222-44e5-b41d-95fb6dda9947 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:16.125062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85d059-f222-44e5-b41d-95fb6dda9947 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:16.126966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 272/541] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:16.132889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8d982-e973-45fd-a754-7a92083c51a3 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:16.133236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8d982-e973-45fd-a754-7a92083c51a3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:16.133572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8d982-e973-45fd-a754-7a92083c51a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:16.136268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:16.165486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2ce8d982-e973-45fd-a754-7a92083c51a3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:16.168989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2ce8d982-e973-45fd-a754-7a92083c51a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:16.222912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:16.277943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76e14-4c39-48c2-8e55-ee9ec867660a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:16.315958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 273/542] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:16.318196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:16.318944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:16.319338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:16.319722 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:16.320611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=323b7d02f817475791098f32bf1c953e) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:16.321067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:16.322766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:16.330189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 270/543] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:16 2022] GET /identity/v3/role_assignments?user.id=323b7d02f817475791098f32bf1c953e&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:16.728356 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8d982-e973-45fd-a754-7a92083c51a3 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:16.873691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8d982-e973-45fd-a754-7a92083c51a3 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:16.931757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eea099-3305-4c4e-82b6-47d3f6b5fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:16.932734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eea099-3305-4c4e-82b6-47d3f6b5fb6e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:16.933207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eea099-3305-4c4e-82b6-47d3f6b5fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:16.933679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eea099-3305-4c4e-82b6-47d3f6b5fb6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:16.950653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eea099-3305-4c4e-82b6-47d3f6b5fb6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-a1eea099-3305-4c4e-82b6-47d3f6b5fb6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:16.956358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:16.957263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:16.958093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:16.960110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 274/544] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:16.966910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:17.213659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:17.223625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561fc55-2aff-43a9-a9a1-99f5b37c3def None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:17.300956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430c8d8-63af-4bcc-a87d-80185c2389b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:17.301919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c8d8-63af-4bcc-a87d-80185c2389b0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:17.302354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c8d8-63af-4bcc-a87d-80185c2389b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:17.302789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430c8d8-63af-4bcc-a87d-80185c2389b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:17.303859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c8d8-63af-4bcc-a87d-80185c2389b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:17.304336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c8d8-63af-4bcc-a87d-80185c2389b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:17.306750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430c8d8-63af-4bcc-a87d-80185c2389b0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:17.326278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 271/545] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:17.331736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eea099-3305-4c4e-82b6-47d3f6b5fb6e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:17.374772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:17.495731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eea099-3305-4c4e-82b6-47d3f6b5fb6e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:17.504665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc83f-0b88-4275-8148-4a38b6e37bfc None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:17.505145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc83f-0b88-4275-8148-4a38b6e37bfc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:17.505677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bc83f-0b88-4275-8148-4a38b6e37bfc None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:17.508191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 272/546] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:17.519376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fdeb-c522-4855-ac0c-4fc8eedf34ed None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:17.519856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fdeb-c522-4855-ac0c-4fc8eedf34ed None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:17.520518 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fdeb-c522-4855-ac0c-4fc8eedf34ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:17.557448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ce53fdeb-c522-4855-ac0c-4fc8eedf34ed None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:17.559663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ce53fdeb-c522-4855-ac0c-4fc8eedf34ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:17.564703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:17.565354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:17.565652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:17.565927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:17.590642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:17.594442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:17.624647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:17.626422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:17.628175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:17.628175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:17.628175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:17.628175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 275/547] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:17.635035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:17.719612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 273/548] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:17.770903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:17.817297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9b340-58c2-4e65-9969-d8747b97aacf None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:17.835000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc08f-da09-4f32-88df-39db0d4b203d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:17.835395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc08f-da09-4f32-88df-39db0d4b203d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:17.835547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fc08f-da09-4f32-88df-39db0d4b203d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:17.836898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 274/549] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:25:17.850360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a481b-51ad-4226-a889-99920059e239 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:17.850695 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a481b-51ad-4226-a889-99920059e239 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:17.850903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a481b-51ad-4226-a889-99920059e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:17.886641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ea9a481b-51ad-4226-a889-99920059e239 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:17.887868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ea9a481b-51ad-4226-a889-99920059e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:17.898868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:17.899492 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:17.899794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:17.900563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:17.901258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:17.901683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:17.903091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:17.917489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 276/550] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:17.926252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:18.043071 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 275/551] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:18.106040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798426f-3bdc-4d63-b802-5b4571cfa983 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:18.162663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:18.168677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:18.169313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.169619 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.169893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.179623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a481b-51ad-4226-a889-99920059e239 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:18.184706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:18.186238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:18.211997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:18.213474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:18.214565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:18.220399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 277/552] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:18.221006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:18.226782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:18.369114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a481b-51ad-4226-a889-99920059e239 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:18.403672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83aac6-4c91-4317-b830-0a02e49e5a52 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:18.405151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2262455-c003-4687-8ca2-302ea7ddc777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:18.406372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2262455-c003-4687-8ca2-302ea7ddc777 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.406651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2262455-c003-4687-8ca2-302ea7ddc777 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.406923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2262455-c003-4687-8ca2-302ea7ddc777 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.418081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2262455-c003-4687-8ca2-302ea7ddc777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a2262455-c003-4687-8ca2-302ea7ddc777 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:18.423181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:18.425053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 276/553] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:18.426668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2262455-c003-4687-8ca2-302ea7ddc777 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:18.449557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:18.450201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.450484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.450763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.452935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:18.453372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:18.455346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:18.484799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 278/554] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Oct 3 12:25:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:18.485851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:18.531217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:18.555474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2262455-c003-4687-8ca2-302ea7ddc777 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:18.562584 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:18.598052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc3ca-20fe-407d-b22b-3cc9d93793e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:18.598694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc3ca-20fe-407d-b22b-3cc9d93793e2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.598979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc3ca-20fe-407d-b22b-3cc9d93793e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.599254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc3ca-20fe-407d-b22b-3cc9d93793e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.611594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dc3ca-20fe-407d-b22b-3cc9d93793e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-321dc3ca-20fe-407d-b22b-3cc9d93793e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:18.616873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:18.617928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 277/555] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:18.618786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc3ca-20fe-407d-b22b-3cc9d93793e2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:18.636321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c40f9-a946-4fc8-98c9-c77b797d4324 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:18.675642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed426-a086-4a16-a05d-d3df7fbed2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:18.676259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed426-a086-4a16-a05d-d3df7fbed2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.676543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed426-a086-4a16-a05d-d3df7fbed2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.676818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed426-a086-4a16-a05d-d3df7fbed2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.677485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed426-a086-4a16-a05d-d3df7fbed2f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:18.677839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed426-a086-4a16-a05d-d3df7fbed2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:18.679214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed426-a086-4a16-a05d-d3df7fbed2f8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:18.692992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 279/556] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:18.694300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209b75-d479-4605-ba46-8890d66e4a80 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.694593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209b75-d479-4605-ba46-8890d66e4a80 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.694874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41209b75-d479-4605-ba46-8890d66e4a80 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.697571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 280/557] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:18.697571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41209b75-d479-4605-ba46-8890d66e4a80 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:18.739537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc3ca-20fe-407d-b22b-3cc9d93793e2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:18.784899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b86f2-d10c-4f9f-b55b-363e31ecc874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:18.785527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b86f2-d10c-4f9f-b55b-363e31ecc874 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.785825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b86f2-d10c-4f9f-b55b-363e31ecc874 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.786106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b86f2-d10c-4f9f-b55b-363e31ecc874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.802436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:18.823207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41209b75-d479-4605-ba46-8890d66e4a80 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:18.838130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:18.862438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:18.863052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.863337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.863813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.864266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:18.864575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:18.866374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:18.869199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b86f2-d10c-4f9f-b55b-363e31ecc874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:18.870687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b86f2-d10c-4f9f-b55b-363e31ecc874 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:18.880830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 281/558] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:18.880830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:18.987243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 278/559] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:18.988313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe2d53-988b-4040-a835-8510709a4037 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:18.988598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe2d53-988b-4040-a835-8510709a4037 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:18.988927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe2d53-988b-4040-a835-8510709a4037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:18.993826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c286a-b71c-4f46-ac16-e1d86dc1369b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.008946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b1fe2d53-988b-4040-a835-8510709a4037 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:19.010592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b1fe2d53-988b-4040-a835-8510709a4037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:19.030960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.031617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.031916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.032204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.045497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.047579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.055921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:19.065456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:19.066725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:19.067889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:19.067889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:19.067889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:19.069372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 282/560] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:19.070340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.090303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 279/561] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:19.091155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe2d53-988b-4040-a835-8510709a4037 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.149905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:19.202890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe2d53-988b-4040-a835-8510709a4037 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.210332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9cb7-b311-48bc-845d-dc914103c9ad None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.241087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86eb83-d007-4f37-aee5-f26237ace50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.241688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86eb83-d007-4f37-aee5-f26237ace50f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.242526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86eb83-d007-4f37-aee5-f26237ace50f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.242526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86eb83-d007-4f37-aee5-f26237ace50f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.247408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.248045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.248329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.248607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.260558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86eb83-d007-4f37-aee5-f26237ace50f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.260788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.262283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.262614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86eb83-d007-4f37-aee5-f26237ace50f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:19.277907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:19.279086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:19.280188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:19.280188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:19.280188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-eb86eb83-d007-4f37-aee5-f26237ace50f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:19.282461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:19.283649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:19.284647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:19.284647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:19.284647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:19.284857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 283/562] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:19.285121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.286565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 280/563] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:19.287974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054399-e324-44c2-99b6-3196c873ab0e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.288261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054399-e324-44c2-99b6-3196c873ab0e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.288541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054399-e324-44c2-99b6-3196c873ab0e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.289949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 281/564] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:19.294495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054399-e324-44c2-99b6-3196c873ab0e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.321803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:19.373345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:19.396602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189528b-78a4-4f41-bf7c-667e7a9907c2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.403956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054399-e324-44c2-99b6-3196c873ab0e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.431528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.432141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.432417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.432689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.433333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:19.433673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.435048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.438822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9e70d-9929-4eef-a2ff-4bbd7f5aa7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.439441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e70d-9929-4eef-a2ff-4bbd7f5aa7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.439714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e70d-9929-4eef-a2ff-4bbd7f5aa7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.439989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9e70d-9929-4eef-a2ff-4bbd7f5aa7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.440634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9e70d-9929-4eef-a2ff-4bbd7f5aa7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:19.440941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9e70d-9929-4eef-a2ff-4bbd7f5aa7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.442362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9e70d-9929-4eef-a2ff-4bbd7f5aa7f3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.447789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 284/565] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:19.448444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.456728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 282/566] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:19.458210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778739a-add0-45e5-b0e2-0eaed0d2d887 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.458499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778739a-add0-45e5-b0e2-0eaed0d2d887 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.458870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778739a-add0-45e5-b0e2-0eaed0d2d887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.477458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9778739a-add0-45e5-b0e2-0eaed0d2d887 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:19.478704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9778739a-add0-45e5-b0e2-0eaed0d2d887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:19.555866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 283/567] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:19.556804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778739a-add0-45e5-b0e2-0eaed0d2d887 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.565994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a42462-7f55-4ce8-bc5e-b207d70dd953 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.572784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:19.608165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.608802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.609084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.609367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.610049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:19.610359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.611740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.619335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:19.630239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 285/568] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:19.631145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.693186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778739a-add0-45e5-b0e2-0eaed0d2d887 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.734872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fd52e-f711-4bae-9bc7-87b5f997aafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.735514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fd52e-f711-4bae-9bc7-87b5f997aafc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.735796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fd52e-f711-4bae-9bc7-87b5f997aafc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.736073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fd52e-f711-4bae-9bc7-87b5f997aafc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.743937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b1025-6f6c-4343-8781-1592ee2720a9 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.749885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fd52e-f711-4bae-9bc7-87b5f997aafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c66fd52e-f711-4bae-9bc7-87b5f997aafc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:19.754854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:19.755999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 284/569] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:19.756846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fd52e-f711-4bae-9bc7-87b5f997aafc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.788283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.788920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.789236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.789492 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.798940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.800402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:19.813292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:19.814489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 286/570] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:19.815983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.841350 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:19.877345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fd52e-f711-4bae-9bc7-87b5f997aafc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.883074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:19.912136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.912777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.913061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.913333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.920690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.922654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.926398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5fd65-39aa-469c-b560-19195a646b67 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:19.934448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:19.935668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 285/571] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:19.937644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:19.963743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:19.964391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:19.964672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:19.964956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:19.972895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:19.974425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:19.988999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:19.995262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 287/572] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:19.996249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.038963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3ab2d-afd6-4fcc-8e7b-c7a0bce95876 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.070946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:20.076311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.076924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.077239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.077529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.078209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:20.078515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.079892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.088627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 286/573] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:20.089605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.100719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19445-56b7-4162-aaba-73c2645ab7bb None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.119200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:20.137129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.137770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.138063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.138340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.139114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:20.139424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.141004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.159564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 288/574] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Oct 3 12:25:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:20.160432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.194195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01a9f1-643d-44c0-8c19-4d879b5c488b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.231841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c04d-0cb2-41e3-be48-58b004b4eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.232491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c04d-0cb2-41e3-be48-58b004b4eb9c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.232776 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c04d-0cb2-41e3-be48-58b004b4eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.233049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c04d-0cb2-41e3-be48-58b004b4eb9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.245567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c04d-0cb2-41e3-be48-58b004b4eb9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5f37c04d-0cb2-41e3-be48-58b004b4eb9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:20.251565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:20.252642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 287/575] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:20.253672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c04d-0cb2-41e3-be48-58b004b4eb9c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.272852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0fc1-4e5b-4b32-af2b-5450002b21fb None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.310317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.310928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.311215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.311536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.312269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:20.312577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.312902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:20.314051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.332821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 289/576] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:20.333623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.366435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c04d-0cb2-41e3-be48-58b004b4eb9c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.371438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:20.400297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.400914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.401205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.401482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.402217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:20.402529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.404001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.419364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 288/577] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:20.420650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.445216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0811b3d-0f9f-4bb7-9806-dd565e0ca46d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.489783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.490677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.490966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.491242 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.501958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.503420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:20.519900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:20.520941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:20.521869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:20.521869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:20.521869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:20.521869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 290/578] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:20.521869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.536957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39e854-cac8-4711-b651-f9aa3721767e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.551601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:20.575853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.576504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.576787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.577580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.588159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.589564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:20.605205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:20.606624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:20.608082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:20.608082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:20.608082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:20.608082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 289/579] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:20.608082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.612557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:20.629459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551031d-2014-4e17-8d21-05bfed960175 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.665741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.666458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.666745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.667023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.667694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:20.668003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.669386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.678000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 291/580] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:20.681696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.720369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7fe18-302a-4e45-a300-80c8dd63b58e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.754146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.754782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.755063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.755339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.767458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.768933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.782901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f997d-1a3d-46ae-9b10-7e797f9fc336 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:20.783933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:20.784845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:20.785796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:20.785796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:20.785796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:20.785796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 290/581] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:20.786027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.805410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:20.822908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.823505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.823790 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.824067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.824794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=f15a3709dbdf43efab86e3bed4977095) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:20.825107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.826575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.832726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 292/582] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/role_assignments?user.id=f15a3709dbdf43efab86e3bed4977095&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:20.833921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.852546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:20.904965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cd16a-79fd-4e82-801a-c34bf2d30afd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:20.943461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:20.944369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:20.944706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:20.944910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:20.945591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:20.945899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:20.947309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:20.968226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 291/583] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:20.968226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:20.968501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086393a1-a541-4566-86c1-2326f59917f6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.008599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.009352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.009655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.009935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.010601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:21.010910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.012316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 293/584] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:21.029777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.065742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:21.091323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14e05-8bdd-4b10-bfd3-6c284f6593d3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.104297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:21.128756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.129395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.129701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.129973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.137483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c9ed7-64b7-443a-842d-8792fafd49af None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.142235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.143682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:21.160111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:21.161137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:21.162104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:21.162104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:21.162104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:21.162104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 292/585] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:21.162104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.186024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.187579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.188014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.188331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.189115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:21.189425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.190851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.208865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 294/586] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:21.208865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.274919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb654-9a21-4bdc-bb10-a2d9bdd0e70a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.306940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:21.315677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.316322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.316783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.317057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.320092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80c6a1-20d6-4e89-abc7-c07384c9c368 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.326438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.337467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:21.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:21.350792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:21.351739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:21.355747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 293/587] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:21.356384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.365912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:21.373590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.374780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.375102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.375384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.383260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.384726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:21.396859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:21.406865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 295/588] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:21.408231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.484292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60b6e7-20ac-49fa-b0ba-c81fefacd33a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.511531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3f1fc-fd6a-42bd-8493-9dcc38134931 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.522406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.523246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.523694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.524125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.524928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:21.525380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.526918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.544130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 294/589] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:21.544130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.551502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.552132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.552409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.552677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.559640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.561096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:21.573148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:21.574383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 296/590] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:21.575588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.602415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:21.631645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:21.662600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed3cd2-648f-4dfe-90f4-bef56de8cf02 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.680185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150a32-0cdf-4887-8fa7-b3c8ed02e456 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.710074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.710959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.711914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.712361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.713602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:21.714058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.716352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.726375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.727154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.727440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.727761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.728621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:21.728942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.730776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.741749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 295/591] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:21.742982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.758475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 297/592] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:21.759840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.856810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb8659-15f1-4683-b578-a3aad23a5d9c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.866584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:21.896278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1212951-d9a2-41cc-a704-1d5d506e3dab None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:21.898261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.899704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.899984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.900257 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.908918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.909667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:21.910923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:21.925437 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:21.926409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 12:25:21.927345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:21.927893 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 296/593] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:21.928459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:21.935352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:21.935964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:21.936872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:21.937067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:21.937767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:21.938073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:21.939507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:21.951120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 298/594] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:21.951940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:22.042577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d104c-83ba-49b1-b8f9-f39e1b699463 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:22.055467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499a208-f97a-4718-ade1-a404097d76e6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:22.079387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:22.080014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:22.080300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:22.080571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:22.092137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:22.093633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:22.095406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45fbd-06e4-4daf-aeb8-cbb9244bcc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:22.096306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45fbd-06e4-4daf-aeb8-cbb9244bcc9a None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:22.096465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45fbd-06e4-4daf-aeb8-cbb9244bcc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:22.096605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b45fbd-06e4-4daf-aeb8-cbb9244bcc9a None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/d676c76b05924c4ab06940f04996fa3f/roles/8620609e2f8a4b039384fd7a3d24253d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:22.111357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:22.112840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:22.114977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:22.114977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:22.114977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:22.114977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 297/595] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:22.114977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:22.115734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b45fbd-06e4-4daf-aeb8-cbb9244bcc9a None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=d676c76b05924c4ab06940f04996fa3f, role_id=8620609e2f8a4b039384fd7a3d24253d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:22.116282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b45fbd-06e4-4daf-aeb8-cbb9244bcc9a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:22.141917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 299/596] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:25:21 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/d676c76b05924c4ab06940f04996fa3f/roles/8620609e2f8a4b039384fd7a3d24253d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:25:22.141917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45fbd-06e4-4daf-aeb8-cbb9244bcc9a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:22.163476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:22.175288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:22.267037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0190e-adf4-4745-869a-088fd75935fd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:22.269491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b45fbd-06e4-4daf-aeb8-cbb9244bcc9a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:22.316773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d690b-8607-48d3-96dc-a434d5c48fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:22.317644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d690b-8607-48d3-96dc-a434d5c48fd1 None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:22.318030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d690b-8607-48d3-96dc-a434d5c48fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:22.318203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:22.318524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d690b-8607-48d3-96dc-a434d5c48fd1 None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/1e81eb41d8264474917e3b4f3fa2becd/roles/8620609e2f8a4b039384fd7a3d24253d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:22.318828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:22.319107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:22.319379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:22.320143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:22.320414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:22.322252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:22.336906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d690b-8607-48d3-96dc-a434d5c48fd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=1e81eb41d8264474917e3b4f3fa2becd, role_id=8620609e2f8a4b039384fd7a3d24253d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:22.338872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d690b-8607-48d3-96dc-a434d5c48fd1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:22.349756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 298/597] 10.222.0.17 () {56 vars in 1139 bytes} [Mon Oct 3 12:25:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:22.350946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:22.359278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 300/598] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:25:22 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/1e81eb41d8264474917e3b4f3fa2becd/roles/8620609e2f8a4b039384fd7a3d24253d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:25:22.362297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d690b-8607-48d3-96dc-a434d5c48fd1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:22.456794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:22.461031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:22.497950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0f71c-4621-48d1-8759-f82f8d439dd5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:22.506658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d690b-8607-48d3-96dc-a434d5c48fd1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:22.544638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:22.546268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:22.547383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:22.547896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:22.548795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:22.549301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:22.551178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:22.565716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 299/599] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:22.571139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:22.582522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:22.583170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:22.583451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:22.583728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:22.602186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:22.603681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:22.620936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:22.622257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:22.623125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:22.623125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:22.623125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:22.623125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 301/600] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:22.627628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:22.695895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8e805-5104-434a-afb8-f1ca5731ab4d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:22.768257 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:22.771015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:22.771514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:22.771983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:22.788924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:22.790736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:22.794967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fedd5-dda8-4942-a815-7b51e533803c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:22.805870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:22.820291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:22.821241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:22.822152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:22.822152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:22.822152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:22.822152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:22.822152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:22.822152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:22.822152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:22.822152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:22.823609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 300/601] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:22.830020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:22.849229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:22.866326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:22.867423 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:22.867705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:22.868264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:22.869032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:22.869502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:22.875115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:22.891132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 302/602] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:22.903713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:23.042904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785f136-fc3a-41e0-9f7d-702087c8bb64 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:23.078747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610ea3e-480d-42b2-b09d-81a0a29a30f5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:23.115960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:23.116816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:23.117196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:23.117594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:23.122242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:23.123435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:23.124401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:23.124825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:23.125747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:23.125991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:23.126386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:23.127638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:23.128146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:23.140241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:23.141176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:23.142085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:23.142085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:23.142085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:23.142085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:23.142085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:23.142085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:23.142085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:23.142085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:23.144577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 303/603] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:23.150314 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 301/604] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:23.151611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:23.156205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:23.229887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:23.245817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:23.290577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64deb1-82ee-4dca-844a-c9ae3b765d15 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:23.292818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681c876-029d-4a7f-86b2-a511fe9d6bc9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:23.329188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc4114-5084-4a0d-9422-37b9a622d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:23.329891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4114-5084-4a0d-9422-37b9a622d11f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:23.330247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4114-5084-4a0d-9422-37b9a622d11f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:23.330632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4114-5084-4a0d-9422-37b9a622d11f None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:23.331472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc4114-5084-4a0d-9422-37b9a622d11f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:23.331878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc4114-5084-4a0d-9422-37b9a622d11f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:23.333008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d30ade-f7d5-4365-92f1-dcd17873144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:23.333557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc4114-5084-4a0d-9422-37b9a622d11f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:23.334045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d30ade-f7d5-4365-92f1-dcd17873144a None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:23.334486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d30ade-f7d5-4365-92f1-dcd17873144a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:23.334909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d30ade-f7d5-4365-92f1-dcd17873144a None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/589b89539f8d43e993201fab13cd443a/roles/8620609e2f8a4b039384fd7a3d24253d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:23.346946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 304/605] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:23.348728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9b07f-b3a1-482a-9e1f-56a708628e69 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:23.349112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9b07f-b3a1-482a-9e1f-56a708628e69 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:23.349565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9b07f-b3a1-482a-9e1f-56a708628e69 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:23.352242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d30ade-f7d5-4365-92f1-dcd17873144a None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=589b89539f8d43e993201fab13cd443a, role_id=8620609e2f8a4b039384fd7a3d24253d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:23.353901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d30ade-f7d5-4365-92f1-dcd17873144a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:23.355296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 305/606] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:23.356187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9b07f-b3a1-482a-9e1f-56a708628e69 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:23.374634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 302/607] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:25:23 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/589b89539f8d43e993201fab13cd443a/roles/8620609e2f8a4b039384fd7a3d24253d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:25:23.383149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceb250-6a22-4751-9c9f-4ef5417aaf20 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:23.384934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceb250-6a22-4751-9c9f-4ef5417aaf20 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:23.388023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceb250-6a22-4751-9c9f-4ef5417aaf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:23.425681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-93ceb250-6a22-4751-9c9f-4ef5417aaf20 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:23.432909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-93ceb250-6a22-4751-9c9f-4ef5417aaf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:23.537275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9b07f-b3a1-482a-9e1f-56a708628e69 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:23.540349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:23.580624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b699b3-065d-4e47-935b-9db29dea11db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:23.582308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b699b3-065d-4e47-935b-9db29dea11db None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:23.582308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b699b3-065d-4e47-935b-9db29dea11db None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:23.582308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b699b3-065d-4e47-935b-9db29dea11db None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/323b7d02f817475791098f32bf1c953e/roles/8620609e2f8a4b039384fd7a3d24253d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:23.584499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 303/608] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:23.603821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b699b3-065d-4e47-935b-9db29dea11db None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=323b7d02f817475791098f32bf1c953e, role_id=8620609e2f8a4b039384fd7a3d24253d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:23.606082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b699b3-065d-4e47-935b-9db29dea11db None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:23.625727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 306/609] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:25:23 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/323b7d02f817475791098f32bf1c953e/roles/8620609e2f8a4b039384fd7a3d24253d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:25:23.924666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceb250-6a22-4751-9c9f-4ef5417aaf20 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:23.971416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:24.035156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceb250-6a22-4751-9c9f-4ef5417aaf20 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:24.087166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f1b2d-a651-4d48-9200-c219f85af9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:24.087814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1b2d-a651-4d48-9200-c219f85af9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:24.088091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1b2d-a651-4d48-9200-c219f85af9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:24.088359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f1b2d-a651-4d48-9200-c219f85af9a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:24.105500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f1b2d-a651-4d48-9200-c219f85af9a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c43f1b2d-a651-4d48-9200-c219f85af9a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:24.111001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:24.111920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:24.112768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 304/610] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:24.118704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b699b3-065d-4e47-935b-9db29dea11db None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:24.288152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b699b3-065d-4e47-935b-9db29dea11db None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:24.325091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:24.325770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:24.326051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:24.326319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:24.327527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:24.327827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:24.329195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:24.338704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 307/611] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:24.344894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f1b2d-a651-4d48-9200-c219f85af9a4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:24.470042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:24.473608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f1b2d-a651-4d48-9200-c219f85af9a4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:24.527635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:24.528290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:24.528636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:24.528915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:24.543660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:24.545488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:24.564489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:24.565489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:24.570743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:24.570743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:24.570743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:24.572370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 305/612] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:24.579360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:24.617986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:24.729413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5aa86-b7f6-4b3c-b55a-64cfce30e040 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:24.765333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcea21-37d4-4311-a5fb-18ca5c397b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:24.765972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcea21-37d4-4311-a5fb-18ca5c397b86 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:24.766251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcea21-37d4-4311-a5fb-18ca5c397b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:24.766522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcea21-37d4-4311-a5fb-18ca5c397b86 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:24.767162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcea21-37d4-4311-a5fb-18ca5c397b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:24.767465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcea21-37d4-4311-a5fb-18ca5c397b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:24.768858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcea21-37d4-4311-a5fb-18ca5c397b86 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:24.782267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 308/613] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:24.787918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:24.815628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a62e2-540c-4947-8291-1515683dc32b None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:24.815933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a62e2-540c-4947-8291-1515683dc32b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:24.816284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a62e2-540c-4947-8291-1515683dc32b None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:24.818019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 309/614] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:25:24.825561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfd16c-5709-47d8-b78a-62af3a7fd37a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:24.825561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfd16c-5709-47d8-b78a-62af3a7fd37a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:24.825561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfd16c-5709-47d8-b78a-62af3a7fd37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:24.877343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2abfd16c-5709-47d8-b78a-62af3a7fd37a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:24.879279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2abfd16c-5709-47d8-b78a-62af3a7fd37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:24.995896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35affcb5-bad0-434c-847d-36fda3f1eaab None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:24.997737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 310/615] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:24.999560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62fb0-5138-4aa8-bcb3-ee9f3d0018e1 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:24.999843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62fb0-5138-4aa8-bcb3-ee9f3d0018e1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.000112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f62fb0-5138-4aa8-bcb3-ee9f3d0018e1 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.005504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 311/616] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:25.006840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79865f-b730-4157-9966-f9123f811749 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:25.007197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79865f-b730-4157-9966-f9123f811749 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.007542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79865f-b730-4157-9966-f9123f811749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.021564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:25.027926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5a79865f-b730-4157-9966-f9123f811749 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:25.029226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5a79865f-b730-4157-9966-f9123f811749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:25.043195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:25.044137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:25.044564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.044995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.064988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:25.066763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:25.090900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:25.092010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:25.093205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:25.095446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 306/617] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:25.101982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:25.109973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 312/618] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:25.125824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:25.261846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15587af6-987d-4057-88c6-0aa99edba23a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:25.319147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:25.320012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:25.320462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.320880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.321784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:25.322267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:25.323835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:25.349141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 307/619] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Oct 3 12:25:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:25.354525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79865f-b730-4157-9966-f9123f811749 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:25.400822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:25.475776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79865f-b730-4157-9966-f9123f811749 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:25.510047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:25.527287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:25.527953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:25.528220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.528498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.533275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:25.545046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:25.547795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:25.552859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec578-284b-49df-9438-9398c9da0b19 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:25.567263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:25.568345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:25.569412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:25.569412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:25.569412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:25.569412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 313/620] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:25.569683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:25.600525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b9c47-4c27-4121-9f10-098425049d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:25.601607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b9c47-4c27-4121-9f10-098425049d9c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:25.603038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b9c47-4c27-4121-9f10-098425049d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.603523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b9c47-4c27-4121-9f10-098425049d9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.618797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b9c47-4c27-4121-9f10-098425049d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ec8b9c47-4c27-4121-9f10-098425049d9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:25.624532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:25.625504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:25.626381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:25.629221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 308/621] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:25.630534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b9c47-4c27-4121-9f10-098425049d9c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:25.705140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d2f16-34c0-470e-92d6-ea1d05496c18 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:25.743907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1507ea-ccd7-4ae1-b637-892ef088920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:25.745006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1507ea-ccd7-4ae1-b637-892ef088920a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:25.745597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1507ea-ccd7-4ae1-b637-892ef088920a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.746084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1507ea-ccd7-4ae1-b637-892ef088920a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.754779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b9c47-4c27-4121-9f10-098425049d9c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:25.758864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1507ea-ccd7-4ae1-b637-892ef088920a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-8c1507ea-ccd7-4ae1-b637-892ef088920a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:25.765349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:25.766448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:25.767296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:25.770147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 314/622] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:25.771264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1507ea-ccd7-4ae1-b637-892ef088920a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:25.786808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:25.796765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:25.797388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:25.797729 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.798002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.798654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:25.798957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:25.800320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:25.817242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 309/623] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:25.819031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:25.841838 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:25.901259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1507ea-ccd7-4ae1-b637-892ef088920a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:25.939692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:25.940756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:25.941240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:25.941766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:25.942664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:25.943168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:25.944744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:25.954347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 315/624] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:25.955464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:25.964478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e9ece-feb7-4d99-856d-36148c8c37d9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.005100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.006102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.006583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.007053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.008043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:26.008546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.010277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.020664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 310/625] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:26.021875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.083746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1da174-b874-4003-8962-2b1dd96b8c57 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.090308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:26.096970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:26.131061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.131773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.132062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.132343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.143183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.144969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.152653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6190f-789e-499e-bd49-3f5c6bc0c36b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:26.161653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:26.162645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:26.163532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:26.163532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:26.163532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:26.163532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:26.163532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:26.163532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:26.163532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:26.163532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:26.165587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 316/626] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:26.166644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.198060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.199323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.199914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.200508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.215325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.216787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:26.231995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:26.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:26.233974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:26.233974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:26.233974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:26.233974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 311/627] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:26.234298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.279548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83507c6-7436-4ceb-84c2-d8d9001d5d3f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.314595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe080b4-d950-4f81-9c88-ce0a11596dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.315232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe080b4-d950-4f81-9c88-ce0a11596dfd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.315516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe080b4-d950-4f81-9c88-ce0a11596dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.315791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe080b4-d950-4f81-9c88-ce0a11596dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.327279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe080b4-d950-4f81-9c88-ce0a11596dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.328743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe080b4-d950-4f81-9c88-ce0a11596dfd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-2fe080b4-d950-4f81-9c88-ce0a11596dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:26.343309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:26.344303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:26.345219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:26.345219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:26.345219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:26.345219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 317/628] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:26.345764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923bd5-4d71-425b-ba1e-0ee89e65faa5 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.345860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923bd5-4d71-425b-ba1e-0ee89e65faa5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.346136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923bd5-4d71-425b-ba1e-0ee89e65faa5 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.347568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 318/629] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:26.352076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923bd5-4d71-425b-ba1e-0ee89e65faa5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.356158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e9c2-f3cd-4c59-a962-36ead5af7cfd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.358038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:26.378615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:26.396048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.396789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.397078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.397354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.398120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:26.398436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.400055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.419321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 312/630] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:26.420362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.468787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923bd5-4d71-425b-ba1e-0ee89e65faa5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.506411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13e20f-a769-47f8-9f8a-8493cb058f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.507119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13e20f-a769-47f8-9f8a-8493cb058f3c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.507466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13e20f-a769-47f8-9f8a-8493cb058f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.507845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13e20f-a769-47f8-9f8a-8493cb058f3c None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.508520 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13e20f-a769-47f8-9f8a-8493cb058f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:26.508893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13e20f-a769-47f8-9f8a-8493cb058f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.510401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13e20f-a769-47f8-9f8a-8493cb058f3c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.522614 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 319/631] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:26.523885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e90e-12ae-41b6-9cac-8699ae7f402c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.524172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e90e-12ae-41b6-9cac-8699ae7f402c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.524444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984e90e-12ae-41b6-9cac-8699ae7f402c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.541382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759e932-189b-4ba3-9c90-fce9896a4825 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.542577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e984e90e-12ae-41b6-9cac-8699ae7f402c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:26.543773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e984e90e-12ae-41b6-9cac-8699ae7f402c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:26.577780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.578393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.578677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.578954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.579603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:26.579906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.581267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.593546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 313/632] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:26.594167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.615525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 320/633] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:26.616799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc0e4-a12e-496d-af0f-1b0e74b3c7f1 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.617090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc0e4-a12e-496d-af0f-1b0e74b3c7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.617373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc0e4-a12e-496d-af0f-1b0e74b3c7f1 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.618763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 321/634] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:26.619466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc0e4-a12e-496d-af0f-1b0e74b3c7f1 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.626833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:26.645161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:26.721916 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49a5d3-4105-49b6-8244-7356561dd1b5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.743669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2bc0e4-a12e-496d-af0f-1b0e74b3c7f1 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.758986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d2678-1db6-4ed2-94c5-e62801930de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.759665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d2678-1db6-4ed2-94c5-e62801930de0 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.759950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d2678-1db6-4ed2-94c5-e62801930de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.760232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d2678-1db6-4ed2-94c5-e62801930de0 None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/f15a3709dbdf43efab86e3bed4977095/roles/8620609e2f8a4b039384fd7a3d24253d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.775986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d2678-1db6-4ed2-94c5-e62801930de0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=f15a3709dbdf43efab86e3bed4977095, role_id=8620609e2f8a4b039384fd7a3d24253d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.777432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d2678-1db6-4ed2-94c5-e62801930de0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.782008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2e0f6-dc39-4347-a82b-8f4c62b5884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:26.782834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e0f6-dc39-4347-a82b-8f4c62b5884f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.783199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e0f6-dc39-4347-a82b-8f4c62b5884f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.783430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e0f6-dc39-4347-a82b-8f4c62b5884f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.791523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2e0f6-dc39-4347-a82b-8f4c62b5884f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:26.801746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 314/635] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:25:26 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/f15a3709dbdf43efab86e3bed4977095/roles/8620609e2f8a4b039384fd7a3d24253d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:25:26.801746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d2678-1db6-4ed2-94c5-e62801930de0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.802062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2e0f6-dc39-4347-a82b-8f4c62b5884f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-9eb2e0f6-dc39-4347-a82b-8f4c62b5884f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:26.806899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:26.808037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 12:25:26.808982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:26.813645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 322/636] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:26.815115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d381-f80d-4e8a-8c3e-2d8ce0baccc9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:26.815404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d381-f80d-4e8a-8c3e-2d8ce0baccc9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:26.815677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d381-f80d-4e8a-8c3e-2d8ce0baccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:26.841151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ee81d381-f80d-4e8a-8c3e-2d8ce0baccc9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:26.843473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ee81d381-f80d-4e8a-8c3e-2d8ce0baccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:26.908921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:26.928940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 323/637] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:26.929802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81d381-f80d-4e8a-8c3e-2d8ce0baccc9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:26.956093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d2678-1db6-4ed2-94c5-e62801930de0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:26.983742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.010061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.010648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.010932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.011206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.021039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:27.022546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:27.035170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:27.036205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 315/638] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:27.037806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.060239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81d381-f80d-4e8a-8c3e-2d8ce0baccc9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.104474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.105536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.105944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.106225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.106962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:27.107275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:27.109453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:27.130574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 324/639] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Oct 3 12:25:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:27.131742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.151158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65999b-4543-4b5e-8b05-97be9fd9e04f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.183890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.190740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7d1c9-25cc-4fa0-9a4d-4bf8b1fa20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.191385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7d1c9-25cc-4fa0-9a4d-4bf8b1fa20c3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.191668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7d1c9-25cc-4fa0-9a4d-4bf8b1fa20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.192062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7d1c9-25cc-4fa0-9a4d-4bf8b1fa20c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.198817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.208364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7d1c9-25cc-4fa0-9a4d-4bf8b1fa20c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5fd7d1c9-25cc-4fa0-9a4d-4bf8b1fa20c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:27.214087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:27.215118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:27.215957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 316/640] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:27.216654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7d1c9-25cc-4fa0-9a4d-4bf8b1fa20c3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.254785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e12d7-ad6d-4a4a-bd6a-2575e9d432ff None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.293552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.294589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.295125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.295600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.296582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:27.297093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:27.298768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:27.318191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 325/641] 10.222.0.17 () {56 vars in 1137 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:27.319457 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.331088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7d1c9-25cc-4fa0-9a4d-4bf8b1fa20c3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.368249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ac6ad-56c9-4239-b949-c10b241baa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.370061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ac6ad-56c9-4239-b949-c10b241baa74 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.370061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ac6ad-56c9-4239-b949-c10b241baa74 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.370061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ac6ad-56c9-4239-b949-c10b241baa74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.429538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cc303-ba01-4772-ae69-6081c7a2c14a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.436080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.447156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ac6ad-56c9-4239-b949-c10b241baa74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:27.448779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ac6ad-56c9-4239-b949-c10b241baa74 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:27.449244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.469040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594177b2-efa8-455c-82c3-b4f58835275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.469701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594177b2-efa8-455c-82c3-b4f58835275f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.469985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594177b2-efa8-455c-82c3-b4f58835275f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.470259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594177b2-efa8-455c-82c3-b4f58835275f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.480673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594177b2-efa8-455c-82c3-b4f58835275f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-594177b2-efa8-455c-82c3-b4f58835275f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:27.485596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:27.486766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:27.487652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 326/642] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:27.488374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594177b2-efa8-455c-82c3-b4f58835275f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.566073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 317/643] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:27.566073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ac6ad-56c9-4239-b949-c10b241baa74 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.601983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594177b2-efa8-455c-82c3-b4f58835275f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.641152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.642038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.642458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.642800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.643540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:27.643923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:27.645386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:27.654244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 327/644] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:27.654939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.683696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.697542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ac6ad-56c9-4239-b949-c10b241baa74 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.703742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.739193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe13c9-817f-4495-b1c2-7c9bd061c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.740433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe13c9-817f-4495-b1c2-7c9bd061c4cc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.740942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe13c9-817f-4495-b1c2-7c9bd061c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.741452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe13c9-817f-4495-b1c2-7c9bd061c4cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.771661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3bae0-9f26-401b-be6c-6303c9b4db88 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.813126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.813770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.814055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.814333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.814995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:27.815306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:27.816931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:27.819078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe13c9-817f-4495-b1c2-7c9bd061c4cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:27.820526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe13c9-817f-4495-b1c2-7c9bd061c4cc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:27.826094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 328/645] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:27.830627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.922634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.933468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82750a-47e5-4b45-8ae6-7bbde7f927f9 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:27.939781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 318/646] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:27.939946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:27.940055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe13c9-817f-4495-b1c2-7c9bd061c4cc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:27.973252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:27.973835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:27.974165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:27.974385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:27.985975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:27.987419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:28.002843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:28.008696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:28.010030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:28.010030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:28.010030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:28.010030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 329/647] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:28.010030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.057927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe13c9-817f-4495-b1c2-7c9bd061c4cc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.095558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.096314 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.096598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.097072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.110900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.112607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66272e-2b04-482b-9e13-426e01d1a8b1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.112981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:28.133066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:28.134157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:28.135027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:28.135027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:28.135027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:28.136198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 319/648] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:28.137078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.150418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.151404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.151934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.152520 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.164585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.166531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:28.182342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:28.183330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:28.184398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:28.184398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:28.184398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:28.186633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 330/649] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:28.186753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:28.187709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.201804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:28.249412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ad2b4-a4e0-4b63-a12a-cfe83f187bec None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.283219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.283911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.284190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.284520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.295720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.297176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.306544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85621f1-63b4-4bea-9cd4-a1c9542910e1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:28.313345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:28.314478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:28.315383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:28.315383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:28.315383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:28.315383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 320/650] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:28.315619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.348301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.349244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.349539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.349846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.350487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:28.350793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.352162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.369696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 331/651] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:28.369696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.426479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:28.434213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dadb2-8b83-4b97-92bc-957a87546b69 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.436664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:28.471452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.472160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.472440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.472713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.473345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:28.473678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.475045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.479458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733155e-b7ab-4009-9548-150ead2be98c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.487786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 321/652] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:28.488604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.526287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.527974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.528410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.528827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.530190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:28.530780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.532917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.554875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 332/653] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:28.555948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.602225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746631-8504-4e48-aaca-b570afc2714f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.642984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.643602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.643881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.644153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.644792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:28.645120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.646515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.663553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 322/654] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:28.663553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.677398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c6bf-ac3b-499c-bb19-b1de49d8ee7a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.693200 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:28.713479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:28.723472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.724110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.724389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.724730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.731862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.733319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:28.745280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:28.746297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 333/655] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:28.747197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.789796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dc7ce-dbee-4554-9444-5282caf2e4a3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.829223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.830051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.830331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.830607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.838574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.840079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:28.852866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:28.853962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:28.854977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:28.855501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b02c3-eb59-4dbc-9a80-9186b2133b97 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:28.858714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 323/656] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:28.859614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.892313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:28.892946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:28.893232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:28.893506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:28.901385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:28.902860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:28.914999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:28.916478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 03 12:25:28.917862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:28.920796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 334/657] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:28.921675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:28.952575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:28.976308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:28.984019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2e1c1-8163-4b2b-8f40-662d213ab908 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.023339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.024081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.024429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.024771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.033588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.035139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.038856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293acc2-07f1-41fa-82bb-5d7c42280a20 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:29.048345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:29.049470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 324/658] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:29.055981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:29.082991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.083701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.084057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.084407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.085135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:29.085452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.086991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.100445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 335/659] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:29.101277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:29.161473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bd7cc-1715-4bff-820e-7462dd05b6d8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.194477 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.195080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.195361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.195631 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.196347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:29.196655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.198110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.200630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:29.204803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9cb759-126b-4bbb-90df-95c0b41d91fc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.213305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:29.217102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 325/660] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:29.217979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:29.245431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02031c3-6ac7-469c-9129-e47c027764c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.246224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02031c3-6ac7-469c-9129-e47c027764c0 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.246513 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02031c3-6ac7-469c-9129-e47c027764c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.246800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02031c3-6ac7-469c-9129-e47c027764c0 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.247518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02031c3-6ac7-469c-9129-e47c027764c0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:29.247824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02031c3-6ac7-469c-9129-e47c027764c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.249821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02031c3-6ac7-469c-9129-e47c027764c0 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.268660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 336/661] 10.222.0.17 () {56 vars in 1139 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:29.270174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b770d-8504-45cd-b6b7-ce216e0dbe0b None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.270455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b770d-8504-45cd-b6b7-ce216e0dbe0b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.270727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b770d-8504-45cd-b6b7-ce216e0dbe0b None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.272090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 337/662] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:29.274085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b770d-8504-45cd-b6b7-ce216e0dbe0b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:29.332441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0da3b-ad26-4c1e-a229-678c277b7349 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.367514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.368131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.368414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.368702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.369413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:29.369755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.371178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.376021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b770d-8504-45cd-b6b7-ce216e0dbe0b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.383104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 326/663] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:29.383909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:29.419795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.420403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.420686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.420963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.421715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=1e81eb41d8264474917e3b4f3fa2becd) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:29.422021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.423463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.429188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 338/664] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/role_assignments?user.id=1e81eb41d8264474917e3b4f3fa2becd&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:29.430015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:29.443883 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:29.473778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:29.500392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7d91b-6541-4217-8699-cfa3c84f27ef None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.539025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5424c-a113-4c72-b4eb-0eada65bffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.539920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5424c-a113-4c72-b4eb-0eada65bffca None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.540266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5424c-a113-4c72-b4eb-0eada65bffca None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.540612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5424c-a113-4c72-b4eb-0eada65bffca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.559487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc1669-9542-4936-a7ce-4a0e78998103 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.599556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5beab1-6681-47e8-b1fa-e828a5e1e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.600321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5beab1-6681-47e8-b1fa-e828a5e1e639 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.600716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5beab1-6681-47e8-b1fa-e828a5e1e639 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.601070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5beab1-6681-47e8-b1fa-e828a5e1e639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.621104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5424c-a113-4c72-b4eb-0eada65bffca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.622716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5424c-a113-4c72-b4eb-0eada65bffca None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.687385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:29.701604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5beab1-6681-47e8-b1fa-e828a5e1e639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.703172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5beab1-6681-47e8-b1fa-e828a5e1e639 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.732102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:29.744912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 327/665] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:29.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697893d1-e712-46dd-b0a9-a7cf885ede2b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.746534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697893d1-e712-46dd-b0a9-a7cf885ede2b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.746809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697893d1-e712-46dd-b0a9-a7cf885ede2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.768037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-697893d1-e712-46dd-b0a9-a7cf885ede2b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:29.769616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-697893d1-e712-46dd-b0a9-a7cf885ede2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:29.820464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 339/666] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:29.820464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5beab1-6681-47e8-b1fa-e828a5e1e639 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:29.858088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 328/667] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:29.858088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697893d1-e712-46dd-b0a9-a7cf885ede2b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:29.933064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5beab1-6681-47e8-b1fa-e828a5e1e639 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.968831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:29.976215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:29.980090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:29.980965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:29.982235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:29.983279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:29.984839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=d676c76b05924c4ab06940f04996fa3f) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:29.985302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:29.987761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:29.996885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 340/668] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/role_assignments?user.id=d676c76b05924c4ab06940f04996fa3f&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:29.997448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697893d1-e712-46dd-b0a9-a7cf885ede2b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:29.998111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.048038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.048987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.049417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.049862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.061959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:30.063812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:30.080861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:30.082117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:30.083225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:30.083225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:30.083225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:30.084791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 329/669] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:30.092433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.211109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec491558-ddc9-4558-ae7d-bf20bb8d84c7 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:30.253179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82605d59-d6b5-4673-822f-9c45f007cfee None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:30.258780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.259641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.260053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.260488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.274892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:30.276905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:30.296352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:30.297370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:30.298367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:30.298367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:30.298367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:30.301901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 341/670] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:30.302710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.304134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.304900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.305192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.305650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.306495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:30.306813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:30.308388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:30.311456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:30.323308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 330/671] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:30.325643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.369919 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:30.433551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279da1e7-1976-4a40-950f-49f1261cc420 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:30.436747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed18f2-03ec-4983-a74d-314c75cdcbad None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:30.469783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.470331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.470439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.470670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.471399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:30.471614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:30.472985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:30.476286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1abcc-0e65-4c65-a267-2169b42dc17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.477489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1abcc-0e65-4c65-a267-2169b42dc17c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.477948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1abcc-0e65-4c65-a267-2169b42dc17c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.478394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1abcc-0e65-4c65-a267-2169b42dc17c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.486093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 331/672] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:30.487056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.492298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1abcc-0e65-4c65-a267-2169b42dc17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-b0b1abcc-0e65-4c65-a267-2169b42dc17c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:30.498746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:30.499779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:30.500661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:30.507930 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 342/673] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:30.509001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1abcc-0e65-4c65-a267-2169b42dc17c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.546937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:30.593760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643979-33ed-429e-b42d-63f6b8f37cee None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:30.630498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1abcc-0e65-4c65-a267-2169b42dc17c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:30.633912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:30.642164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.642822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.643105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.643381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.653088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:30.655672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:30.668762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:30.669805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:30.671203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:30.671203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:30.671203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:30.671203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:30.671203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:30.671203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:30.671203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:30.671203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:30.672650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.673297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.673624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.673976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.678946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 332/674] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:30.680091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.682099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:30.683692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:30.696223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:30.697121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:30.698086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:30.698086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:30.698086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:30.698086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:30.698086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:30.698086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:30.698086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:30.698086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:30.703400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 343/675] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:30.704515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.823220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d8bf5-8620-40e5-9c98-306bab94f196 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:30.843190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c37c8e-2c62-45cd-92c0-0506b8dcb3d9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:30.861077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.861738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.862030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.862296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.862994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:30.863303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:30.865196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:30.865499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:30.883814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 344/676] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:30.885657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.893738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:30.893738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:30.893738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:30.893738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:30.894126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:30.894126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:30.894910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:30.905305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 333/677] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:30.906116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:30.920644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:31.020036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632d1de-a30f-4cea-822e-1eaee900d635 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:31.038511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3f746-a09c-4dbd-a3cb-5141f88e30b0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:31.066422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:31.067047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:31.067330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:31.067607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:31.068860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:31.069188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:31.071040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:31.085473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:31.086445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:31.086950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:31.087078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 345/678] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:31.087553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:31.087920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:31.088719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=589b89539f8d43e993201fab13cd443a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:31.089235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:31.091339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:31.106011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 334/679] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:30 2022] GET /identity/v3/role_assignments?user.id=589b89539f8d43e993201fab13cd443a&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:31.106011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:31.193538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:31.255552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfead26-625a-48cd-943f-4a5366aee48b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:31.258600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:31.292685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:31.293315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:31.293634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:31.293883 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61087-fb5e-4a85-ad48-ff7dbe909b05 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:31.293990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:31.294640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=323b7d02f817475791098f32bf1c953e) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:31.295525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:31.297092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:31.305568 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 335/680] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:31 2022] GET /identity/v3/role_assignments?user.id=323b7d02f817475791098f32bf1c953e&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:31.360770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:31.361353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:31.361661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:31.361940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:31.381171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:31.382667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:31.402235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:31.403259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:31.404929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:31.404929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:31.404929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:31.404929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 346/681] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:31.411555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:31.535211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45200df7-b568-4351-969a-cb04d08f8bf9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:31.544231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:31.574541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:31.575165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:31.575501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:31.575785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:31.576491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:31.576804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:31.578199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:31.592959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 336/682] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:31.597620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:31.729603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c246f-c6e9-4a2e-8bfe-e40a4a9d7b12 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:31.770748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140de40-223c-4b9a-a854-94a5052854ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:31.771404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140de40-223c-4b9a-a854-94a5052854ca None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:31.771689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140de40-223c-4b9a-a854-94a5052854ca None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:31.771972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140de40-223c-4b9a-a854-94a5052854ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:31.775223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:31.781896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140de40-223c-4b9a-a854-94a5052854ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:31.783493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140de40-223c-4b9a-a854-94a5052854ca None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-6140de40-223c-4b9a-a854-94a5052854ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:31.800635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:31.801719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:31.803114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 347/683] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:31.809859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:31.831325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ab4f7-5822-4432-90d0-ec2e7fad8288 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:31.831633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ab4f7-5822-4432-90d0-ec2e7fad8288 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:31.831948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ab4f7-5822-4432-90d0-ec2e7fad8288 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:31.833575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 348/684] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:25:31.839082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ff68-3245-45e3-b45e-8277addf2f54 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:31.839376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ff68-3245-45e3-b45e-8277addf2f54 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:31.839652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9ff68-3245-45e3-b45e-8277addf2f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:31.859595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6df9ff68-3245-45e3-b45e-8277addf2f54 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:31.860812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6df9ff68-3245-45e3-b45e-8277addf2f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:31.963617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 349/685] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:25:32.020243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008ff31-3ed2-4597-9852-2bc6e7232964 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:32.062955 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:32.063588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:32.063871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:32.064347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:32.065091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:32.065399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:32.066879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:32.085740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 337/686] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Oct 3 12:25:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:32.091495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9ff68-3245-45e3-b45e-8277addf2f54 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:32.238271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9ff68-3245-45e3-b45e-8277addf2f54 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:32.267592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:32.282353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def0d6b-bcd0-47f5-a4c9-cf90f3a08789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:32.282999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0d6b-bcd0-47f5-a4c9-cf90f3a08789 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:32.283283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0d6b-bcd0-47f5-a4c9-cf90f3a08789 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:32.283559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def0d6b-bcd0-47f5-a4c9-cf90f3a08789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:32.362270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:32.378843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0d6b-bcd0-47f5-a4c9-cf90f3a08789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:32.380519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def0d6b-bcd0-47f5-a4c9-cf90f3a08789 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:32.391386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:32.483282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8b6f2-60f4-40c7-8d91-fec1128970c8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:32.528372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 350/687] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:32.530063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c8b6-6a55-45f1-9ac0-5db11c06c0f3 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:32.530817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c8b6-6a55-45f1-9ac0-5db11c06c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:32.531096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7c8b6-6a55-45f1-9ac0-5db11c06c0f3 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:32.532991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 351/688] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:32.537984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7c8b6-6a55-45f1-9ac0-5db11c06c0f3 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:32.541839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656582f-0019-4ce2-ad7c-af3d89e0e050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:32.542513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656582f-0019-4ce2-ad7c-af3d89e0e050 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:32.542791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656582f-0019-4ce2-ad7c-af3d89e0e050 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:32.543067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656582f-0019-4ce2-ad7c-af3d89e0e050 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:32.543671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656582f-0019-4ce2-ad7c-af3d89e0e050 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:32.545712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656582f-0019-4ce2-ad7c-af3d89e0e050 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-3656582f-0019-4ce2-ad7c-af3d89e0e050 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:32.557825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:32.558928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:32.559941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 338/689] 10.222.0.17 () {56 vars in 1129 bytes} [Mon Oct 3 12:25:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:32.561334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e2ee1-3403-4477-ac1b-90b1d1aa8677 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:32.561334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e2ee1-3403-4477-ac1b-90b1d1aa8677 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:32.565830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e2ee1-3403-4477-ac1b-90b1d1aa8677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:32.577402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:32.591298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-002e2ee1-3403-4477-ac1b-90b1d1aa8677 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:32.592554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-002e2ee1-3403-4477-ac1b-90b1d1aa8677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:32.659236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7c8b6-6a55-45f1-9ac0-5db11c06c0f3 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:32.665724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 339/690] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:32.666640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e2ee1-3403-4477-ac1b-90b1d1aa8677 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:32.688154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:32.723750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:32.724395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:32.724677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:32.724954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:32.742177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:32.743708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:32.773481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:32.774517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:32.775821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:32.775821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:32.775821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:32.775821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 352/691] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:32.780180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e2ee1-3403-4477-ac1b-90b1d1aa8677 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:32.782196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:32.823396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:32.824022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:32.824302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:32.824575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:32.825213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:32.825535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:32.827814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:32.837447 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 340/692] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Oct 3 12:25:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:32.846491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:32.939053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:32.977009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08babf37-bd88-4d9d-a6fd-d323a604afcc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:32.987241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:33.007918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997c48d-6571-4351-82a6-32a2c3a9b4af None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:33.036487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:33.037021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.037302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.037601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.038251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:33.038553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:33.039996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:33.054675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:33.055306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.055586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.055861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.056500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:33.056807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:33.059927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:33.067944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 353/693] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:33.072919 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:33.074177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 341/694] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Oct 3 12:25:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:33.124752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:33.256108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303b3cf-d627-4a5f-8b2f-868113be4899 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:33.316066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:33.316996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.317474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.317961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.323389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d926d3-93ca-4715-a3e3-ce232e823310 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:33.327307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:33.329029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:33.331211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:33.345975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:33.346976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:33.347876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:33.347876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:33.347876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:33.347876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:33.347876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:33.347876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:33.347876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:33.347876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:33.350344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 354/695] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:33.359608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:33.372416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:33.373608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.374154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.374653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.387885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:33.390154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:33.397479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:33.407335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:33.408442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:33.409394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:33.409394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:33.409394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:33.410879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 342/696] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:33.417123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:33.526431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e4710-637f-4df1-8fb2-bda1ddd97b60 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:33.527662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cf0b7-20bd-411b-bb86-6b7a01d4929f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:33.565157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:33.566583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.567056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.567569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.568434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:33.568939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:33.570663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:33.584773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 343/697] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:33.590211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:33.599703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:33.600738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.601250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.601750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.605446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:33.606155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:33.608088 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:33.641864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 355/698] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:33.642686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:33.679894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:33.743803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c284cd-e1bb-4338-98ba-126c723e3a68 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:33.787487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312da0cd-c54a-4ebc-b2b2-b9eceb0b6334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:33.788286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312da0cd-c54a-4ebc-b2b2-b9eceb0b6334 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.788674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312da0cd-c54a-4ebc-b2b2-b9eceb0b6334 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.789063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312da0cd-c54a-4ebc-b2b2-b9eceb0b6334 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.789927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312da0cd-c54a-4ebc-b2b2-b9eceb0b6334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:33.791577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312da0cd-c54a-4ebc-b2b2-b9eceb0b6334 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:33.817927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 344/699] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:25:33 2022] POST /identity/v3/users => generated 254 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:33.834946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:33.887667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae6be3-804c-4bed-9650-3433c80f2da5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:33.911025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57868d-4e69-4c43-8c9e-9773af3dd8ac None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.911650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57868d-4e69-4c43-8c9e-9773af3dd8ac None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.912130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57868d-4e69-4c43-8c9e-9773af3dd8ac None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.914201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 345/700] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:25:33.923417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc00b7-3cfc-49db-856a-8c1edc022ea9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.924048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc00b7-3cfc-49db-856a-8c1edc022ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.924667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc00b7-3cfc-49db-856a-8c1edc022ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.928042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726f505-f18d-43a3-8152-a6f97c731bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:33.928715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726f505-f18d-43a3-8152-a6f97c731bca None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:33.928962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726f505-f18d-43a3-8152-a6f97c731bca None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:33.929241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726f505-f18d-43a3-8152-a6f97c731bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:33.930103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726f505-f18d-43a3-8152-a6f97c731bca None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=f15a3709dbdf43efab86e3bed4977095) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:33.930422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726f505-f18d-43a3-8152-a6f97c731bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:33.931913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726f505-f18d-43a3-8152-a6f97c731bca None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:33.944136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 356/701] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:33 2022] GET /identity/v3/role_assignments?user.id=f15a3709dbdf43efab86e3bed4977095&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:33.959606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-24fc00b7-3cfc-49db-856a-8c1edc022ea9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:33.961271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-24fc00b7-3cfc-49db-856a-8c1edc022ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:34.079795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 346/702] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:34.325802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8e7fb-a2a6-41aa-a620-d38cfcb6bab7 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:34.326503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8e7fb-a2a6-41aa-a620-d38cfcb6bab7 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:34.326996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8e7fb-a2a6-41aa-a620-d38cfcb6bab7 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:34.328543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 357/703] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:34.334797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f414-4234-48c6-911e-d21bf55a889b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:34.334992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f414-4234-48c6-911e-d21bf55a889b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:34.335382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f414-4234-48c6-911e-d21bf55a889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:34.354905 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4952f414-4234-48c6-911e-d21bf55a889b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:34.356105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4952f414-4234-48c6-911e-d21bf55a889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:34.366647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8e7fb-a2a6-41aa-a620-d38cfcb6bab7 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:34.412286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:34.452409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 347/704] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:34.534825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8e7fb-a2a6-41aa-a620-d38cfcb6bab7 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:34.562023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:34.576408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72af97-4dcd-4e1d-936a-026081c6c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:34.577408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72af97-4dcd-4e1d-936a-026081c6c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:34.577945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72af97-4dcd-4e1d-936a-026081c6c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:34.578423 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72af97-4dcd-4e1d-936a-026081c6c6e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:34.597780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72af97-4dcd-4e1d-936a-026081c6c6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-da72af97-4dcd-4e1d-936a-026081c6c6e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:34.610822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:34.611839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:34.612675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:34.619591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 358/705] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:34.625130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952f414-4234-48c6-911e-d21bf55a889b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:34.807642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72af97-4dcd-4e1d-936a-026081c6c6e2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:34.820122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952f414-4234-48c6-911e-d21bf55a889b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:34.900530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:34.901419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:34.901885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:34.902305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:34.903121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:34.903585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:34.906488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:34.930886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 348/706] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:34.932134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:35.004671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72af97-4dcd-4e1d-936a-026081c6c6e2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:35.007445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:35.065950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:35.068051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:35.070705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:35.071142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] PATH_INFO: `/v3/services/network` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:35.071915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:35.073459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:35.097296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:35.098476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:35.099294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:35.102304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 359/707] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:34 2022] GET /identity/v3/services/network => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:35.111245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:35.149426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c63eb0-e9f0-466a-8bee-61dd90491a27 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:35.212291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:35.213298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:35.213803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:35.214270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:35.219617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:35.228642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:35.230465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:35.245952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:35.246917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:35.248336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:35.248336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:35.248336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:35.250426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 349/708] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:35.256099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:35.349435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:35.363290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05b5c7-13a7-473a-a0bb-f651bfbfd523 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:35.377600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bcbd5-8a39-49ae-adf1-6916b6418d9f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:35.399723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:35.400705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:35.401215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:35.401712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:35.402566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:35.403063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:35.404656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:35.417895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 350/709] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:35.423693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:35.472109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:35.473068 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:35.473621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:35.474099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:35.475322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:35.475812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:35.478277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:35.487312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 360/710] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:25:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:35.496747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:35.536124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bfd18-57f5-4e42-bef1-f32f76976078 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:35.573445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:35.574477 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:35.574979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:35.575560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:35.583614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:35.585325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:35.598269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:35.599253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:35.600373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:35.602975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 351/711] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:25:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:35.609172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:35.623347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:35.715643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604451e1-8fb4-4db3-91f0-64b3068e55ae None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:35.756550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:35.757354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:35.757688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:35.757969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:35.758713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:35.759053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:35.761425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:35.769341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04517c-4d6b-4932-b6a2-9ee9b65e4bb2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:35.783908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 352/712] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:25:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:35.791170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:35.801875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:35.839383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:35.840366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:35.840842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:35.841894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:35.842724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] RBAC: Adding query filter params (type=network) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:35.843254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:35.845032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:35.855995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 361/713] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:25:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:35.923506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:35.976191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036c6ed-a299-4141-a79d-60b5ec0c5d2d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:36.013891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a938f-c845-4eb2-9c73-f1b584dcbd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:36.014853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a938f-c845-4eb2-9c73-f1b584dcbd16 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:36.015327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a938f-c845-4eb2-9c73-f1b584dcbd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:36.015791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a938f-c845-4eb2-9c73-f1b584dcbd16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:36.113726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a938f-c845-4eb2-9c73-f1b584dcbd16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:36.116272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a938f-c845-4eb2-9c73-f1b584dcbd16 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:36.212382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:36.252473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 353/714] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 12:25:36.262570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:36.289238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a3d2-a8de-472f-afc3-2cdaf613e80f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:36.289549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a3d2-a8de-472f-afc3-2cdaf613e80f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:36.289749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459a3d2-a8de-472f-afc3-2cdaf613e80f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:36.291585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 354/715] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:36.297031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ac5b5-3ee4-4bec-b175-739d0aacde2d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:36.297301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ac5b5-3ee4-4bec-b175-739d0aacde2d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:36.297606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ac5b5-3ee4-4bec-b175-739d0aacde2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:36.318960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fe5ac5b5-3ee4-4bec-b175-739d0aacde2d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:36.320225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fe5ac5b5-3ee4-4bec-b175-739d0aacde2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:36.434802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabd7e0-0ccc-4123-8947-1567779723bd None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:36.452837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 355/716] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:36.479520 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:36.480548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:36.481033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:36.481534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:36.494372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:36.496194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:36.512496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:36.514113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:36.515040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:36.515040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:36.515040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:36.517238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 362/717] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:36.522559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ac5b5-3ee4-4bec-b175-739d0aacde2d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:36.650622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:36.658468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ac5b5-3ee4-4bec-b175-739d0aacde2d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:36.721338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad540a7-8cc1-46f9-a0dc-dd1785e4e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:36.722803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad540a7-8cc1-46f9-a0dc-dd1785e4e793 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:36.723318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad540a7-8cc1-46f9-a0dc-dd1785e4e793 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:36.723806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad540a7-8cc1-46f9-a0dc-dd1785e4e793 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:36.724547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad540a7-8cc1-46f9-a0dc-dd1785e4e793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:36.724866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad540a7-8cc1-46f9-a0dc-dd1785e4e793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:36.726271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad540a7-8cc1-46f9-a0dc-dd1785e4e793 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:36.740535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 356/718] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:36.745838 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:36.785773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:36.799745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ed03-fc8f-4486-96e3-b36bf8a33237 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:36.800056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ed03-fc8f-4486-96e3-b36bf8a33237 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:36.800307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ed03-fc8f-4486-96e3-b36bf8a33237 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:36.801686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 357/719] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:36.807092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51907018-5ab3-4763-ae86-ade3b45cf0e3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:36.807385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51907018-5ab3-4763-ae86-ade3b45cf0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:36.807663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51907018-5ab3-4763-ae86-ade3b45cf0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:36.840774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-51907018-5ab3-4763-ae86-ade3b45cf0e3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:36.842091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-51907018-5ab3-4763-ae86-ade3b45cf0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:36.917946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa6af1-d445-46f9-b8da-ea9c86bef724 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:36.938563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 358/720] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:25:36.939430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51907018-5ab3-4763-ae86-ade3b45cf0e3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:36.971297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:36.972324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:36.972800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:36.973302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:36.984711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:36.987759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:37.010689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:37.011667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:37.012618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:37.012618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:37.012618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:37.012618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:37.012618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:37.012618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:37.012618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:37.012618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:37.021031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 363/721] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:37.026591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:37.120223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:37.144803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51907018-5ab3-4763-ae86-ade3b45cf0e3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:37.190465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d648dc1-0ba1-41e3-afc3-c80f03b3816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:37.191024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648dc1-0ba1-41e3-afc3-c80f03b3816e None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:37.191571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648dc1-0ba1-41e3-afc3-c80f03b3816e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:37.191571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648dc1-0ba1-41e3-afc3-c80f03b3816e None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:37.192262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648dc1-0ba1-41e3-afc3-c80f03b3816e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:37.193738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648dc1-0ba1-41e3-afc3-c80f03b3816e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:37.195633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:37.213414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 359/722] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:25:36 2022] POST /identity/v3/services => generated 251 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:37.214728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5914-3f56-43c5-9045-c22d2e4ae0c4 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:37.215013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5914-3f56-43c5-9045-c22d2e4ae0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:37.215288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da5914-3f56-43c5-9045-c22d2e4ae0c4 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:37.216588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 360/723] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:37.222679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6122f-59b8-4775-8168-ccdf2b0b2730 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:37.223033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6122f-59b8-4775-8168-ccdf2b0b2730 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:37.223350 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6122f-59b8-4775-8168-ccdf2b0b2730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:37.240286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134e1b-df05-433e-af9d-59fbfc5d108c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:37.245371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-38e6122f-59b8-4775-8168-ccdf2b0b2730 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:37.246665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-38e6122f-59b8-4775-8168-ccdf2b0b2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:37.314253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:37.314962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:37.315152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:37.315432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:37.316144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:37.316450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:37.318109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:37.337542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 364/724] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:37.337542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:37.359878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 361/725] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 03 12:25:37.360780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6122f-59b8-4775-8168-ccdf2b0b2730 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:37.461240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:37.495246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6122f-59b8-4775-8168-ccdf2b0b2730 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:37.499643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb3c70-c771-4ee8-b8f1-0dd3efac8fb1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:37.539469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422571b-f16d-48ab-bf1b-69d7bfedd9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:37.540057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:37.540182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422571b-f16d-48ab-bf1b-69d7bfedd9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:37.540374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422571b-f16d-48ab-bf1b-69d7bfedd9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:37.540651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422571b-f16d-48ab-bf1b-69d7bfedd9d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:37.540768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:37.540933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:37.541214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:37.541980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=589b89539f8d43e993201fab13cd443a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:37.542292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:37.543947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:37.553602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 362/726] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:37 2022] GET /identity/v3/role_assignments?user.id=589b89539f8d43e993201fab13cd443a&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:37.563139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422571b-f16d-48ab-bf1b-69d7bfedd9d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-4422571b-f16d-48ab-bf1b-69d7bfedd9d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:37.568719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:37.569806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:37.570695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:37.571444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 365/727] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:37.578496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:37.684166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422571b-f16d-48ab-bf1b-69d7bfedd9d8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:37.692581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:37.787470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69de62f-eb35-411f-926e-4fc4bb2948e1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:37.823534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422571b-f16d-48ab-bf1b-69d7bfedd9d8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:37.834627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:37.835596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:37.836085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:37.836569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:37.837473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:37.838034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:37.839649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:37.849654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 363/728] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:37.855759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:37.874386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48f8bb-ce0b-4b45-8ed4-00e042fd72f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:37.874933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48f8bb-ce0b-4b45-8ed4-00e042fd72f5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:37.875218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48f8bb-ce0b-4b45-8ed4-00e042fd72f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:37.875495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48f8bb-ce0b-4b45-8ed4-00e042fd72f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:37.889911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:37.899741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc48f8bb-ce0b-4b45-8ed4-00e042fd72f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-bc48f8bb-ce0b-4b45-8ed4-00e042fd72f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:37.909015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:37.910046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:37.910932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 366/729] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:37.915944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48f8bb-ce0b-4b45-8ed4-00e042fd72f5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:37.996079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:38.009912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd38394-c64c-49f8-ae2e-3fdb48f70fda None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:38.040048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc48f8bb-ce0b-4b45-8ed4-00e042fd72f5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:38.077876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:38.078600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.078909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.079156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.079929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:38.080244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:38.081674 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:38.084501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:38.085163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.085440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.085738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.092061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 367/730] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:38.099137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:38.107049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:38.108512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:38.138697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:38.139712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:38.140618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:38.140618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:38.140618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:38.143327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 364/731] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:38.148210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:38.267312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:38.321021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f8b0-adae-42c4-a734-8c296e6f6831 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:38.352802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616565e7-ac78-4efb-b04d-dee92ae8872f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:38.381910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:38.393182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:38.393848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.394125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.394394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.410955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:38.412439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:38.423347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:38.423970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.424247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.424516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.425246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:38.425630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:38.427856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:38.444571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:38.445626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:38.446537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:38.446537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:38.446537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:38.448055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 368/732] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:38.452948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:38.456191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 365/733] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:38.466695 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:38.624139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a0e7f-d1c1-4374-8aa1-c1352a4fa1a1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:38.632552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5bcb3-2ba3-4a1b-a3ec-b320224187cf None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:38.652463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:38.675751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:38.676683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.677179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.677673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.678162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771c5d4-a4d7-4864-93d8-37a2fc6b28c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:38.678751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:38.678926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c5d4-a4d7-4864-93d8-37a2fc6b28c1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.679319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c5d4-a4d7-4864-93d8-37a2fc6b28c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.679581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:38.679681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771c5d4-a4d7-4864-93d8-37a2fc6b28c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.681317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:38.689417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c5d4-a4d7-4864-93d8-37a2fc6b28c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:38.691183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771c5d4-a4d7-4864-93d8-37a2fc6b28c1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9771c5d4-a4d7-4864-93d8-37a2fc6b28c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:38.708749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:38.709801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:38.710711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 366/734] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:25:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:38.712229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777c898-d0b0-4d15-9b6e-2532d48c1b6c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.712583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777c898-d0b0-4d15-9b6e-2532d48c1b6c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.712928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777c898-d0b0-4d15-9b6e-2532d48c1b6c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.715132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 369/736] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:38.716358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:38.721616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 367/736] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:38.724004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777c898-d0b0-4d15-9b6e-2532d48c1b6c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:38.763097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:38.854261 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afb300-2648-474a-a1af-d015bba5d753 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:38.863065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777c898-d0b0-4d15-9b6e-2532d48c1b6c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:38.907419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:38.907960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43b741-cc6a-4341-962b-b30e5ed8fd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:38.908613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.908721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b741-cc6a-4341-962b-b30e5ed8fd8b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.908994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b741-cc6a-4341-962b-b30e5ed8fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.909342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43b741-cc6a-4341-962b-b30e5ed8fd8b None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.909530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.909966 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.910314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43b741-cc6a-4341-962b-b30e5ed8fd8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:38.910690 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43b741-cc6a-4341-962b-b30e5ed8fd8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:38.912410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43b741-cc6a-4341-962b-b30e5ed8fd8b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:38.921665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:38.923380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:38.932856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 370/737] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Oct 3 12:25:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:38.934156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882cb3-075f-48e6-8b5f-88539dcbb46a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:38.934686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882cb3-075f-48e6-8b5f-88539dcbb46a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:38.934839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882cb3-075f-48e6-8b5f-88539dcbb46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:38.937541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:38.938442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:38.939363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:38.946300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 368/738] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:38.947450 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:38.957487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-76882cb3-075f-48e6-8b5f-88539dcbb46a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:38.958755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-76882cb3-075f-48e6-8b5f-88539dcbb46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:38.986446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:39.041131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 371/739] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 03 12:25:39.042514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882cb3-075f-48e6-8b5f-88539dcbb46a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:39.068680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:39.075516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89125d3-6a46-464b-af0f-3cb3edfe7466 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:39.147142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b719-4d75-464d-9fa8-2e075a799ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:39.148186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b719-4d75-464d-9fa8-2e075a799ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:39.148652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76882cb3-075f-48e6-8b5f-88539dcbb46a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:39.148777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b719-4d75-464d-9fa8-2e075a799ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:39.149170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b719-4d75-464d-9fa8-2e075a799ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:39.213345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:39.215360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:39.216642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:39.217653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:39.219164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:39.219830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:39.224185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:39.255590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 372/740] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Oct 3 12:25:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:39.264461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:39.299909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9b719-4d75-464d-9fa8-2e075a799ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:39.302744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9b719-4d75-464d-9fa8-2e075a799ac1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:39.362644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:39.370028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:39.378223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a17fb-6490-4be0-8720-a001e6d240ea None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:39.505557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 369/741] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 03 12:25:39.514700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b719-4d75-464d-9fa8-2e075a799ac1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:39.548591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fbf7-1f00-4526-82f2-4b23f4f7c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:39.549747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fbf7-1f00-4526-82f2-4b23f4f7c861 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:39.550225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fbf7-1f00-4526-82f2-4b23f4f7c861 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:39.550715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867fbf7-1f00-4526-82f2-4b23f4f7c861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:39.626379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867fbf7-1f00-4526-82f2-4b23f4f7c861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:39.628189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867fbf7-1f00-4526-82f2-4b23f4f7c861 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:39.690791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b719-4d75-464d-9fa8-2e075a799ac1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:39.729026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:39.729697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:39.730031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:39.730392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:39.732986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:39.733950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:39.743395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:39.745364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:39.757214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 373/742] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 03 12:25:39.758529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fbf7-1f00-4526-82f2-4b23f4f7c861 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:39.768048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:39.769045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:39.769962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:39.769962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:39.769962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:39.769962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 370/743] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:39.770195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:39.884611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867fbf7-1f00-4526-82f2-4b23f4f7c861 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:39.910697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291b40f-605a-49d7-8d32-095a3c318e8d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:39.923738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69952ce4-58cc-4afb-a1df-8817a78985aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:39.924506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69952ce4-58cc-4afb-a1df-8817a78985aa None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:39.924880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69952ce4-58cc-4afb-a1df-8817a78985aa None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:39.925467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69952ce4-58cc-4afb-a1df-8817a78985aa None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:39.926035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69952ce4-58cc-4afb-a1df-8817a78985aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:39.927497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69952ce4-58cc-4afb-a1df-8817a78985aa None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:39.946144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 374/744] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:25:39 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:39.947427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69952ce4-58cc-4afb-a1df-8817a78985aa None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:39.966942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:39.968126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:39.968562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:39.969002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:39.984859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:39.986858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:40.006304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:40.007416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:40.008339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:40.008339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:40.008339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:40.008339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 371/745] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:40.014452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:40.022655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:40.059825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:40.142282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6e46f-10bd-49ac-baeb-d4fc9ca26a43 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:40.188164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:40.188840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.189125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.189391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.190106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:40.190413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:40.191692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69952ce4-58cc-4afb-a1df-8817a78985aa None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:40.191861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:40.208831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 372/746] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:40.217882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:40.263657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe312db-4125-4c52-87c6-a8e3dd025c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:40.264207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe312db-4125-4c52-87c6-a8e3dd025c7a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.264489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe312db-4125-4c52-87c6-a8e3dd025c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.264764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe312db-4125-4c52-87c6-a8e3dd025c7a None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.265419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe312db-4125-4c52-87c6-a8e3dd025c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:40.265835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe312db-4125-4c52-87c6-a8e3dd025c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:40.267234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe312db-4125-4c52-87c6-a8e3dd025c7a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:40.280995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 375/747] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:40.283711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a078c7a-ccc4-484e-a14b-70efc185e7ea None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.284001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a078c7a-ccc4-484e-a14b-70efc185e7ea None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.284386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a078c7a-ccc4-484e-a14b-70efc185e7ea None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.286422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 376/748] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:40.287401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a078c7a-ccc4-484e-a14b-70efc185e7ea None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:40.326582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:40.334550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977ce83-170a-48d6-8eb3-542e2e49bcbe None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:40.377120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5877ed6-4296-406b-8f5b-4aa7db93b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:40.377790 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5877ed6-4296-406b-8f5b-4aa7db93b81f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.378075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5877ed6-4296-406b-8f5b-4aa7db93b81f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.378351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5877ed6-4296-406b-8f5b-4aa7db93b81f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.385588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5877ed6-4296-406b-8f5b-4aa7db93b81f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:40.387047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5877ed6-4296-406b-8f5b-4aa7db93b81f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e5877ed6-4296-406b-8f5b-4aa7db93b81f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:40.400688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:40.401700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:40.402617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 373/749] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:40.403827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46352-d711-41a7-9c9d-ec5192d9bf34 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.403827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46352-d711-41a7-9c9d-ec5192d9bf34 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.403827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b46352-d711-41a7-9c9d-ec5192d9bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.428157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-51b46352-d711-41a7-9c9d-ec5192d9bf34 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:40.429380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-51b46352-d711-41a7-9c9d-ec5192d9bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:40.432303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a078c7a-ccc4-484e-a14b-70efc185e7ea None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:40.434116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:40.470273 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a247e-22b6-4185-ace7-cdaa92f3ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:40.470909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a247e-22b6-4185-ace7-cdaa92f3ffdb None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.471184 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a247e-22b6-4185-ace7-cdaa92f3ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.471507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a247e-22b6-4185-ace7-cdaa92f3ffdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.478858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a247e-22b6-4185-ace7-cdaa92f3ffdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:40.480311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a247e-22b6-4185-ace7-cdaa92f3ffdb None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-5b5a247e-22b6-4185-ace7-cdaa92f3ffdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:40.492517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:40.493465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:40.494436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 377/750] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:40.495840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a407d-2172-4755-a325-e1f65f05b9a4 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.495840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a407d-2172-4755-a325-e1f65f05b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.495840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a407d-2172-4755-a325-e1f65f05b9a4 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.501665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 378/751] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:40.502570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a407d-2172-4755-a325-e1f65f05b9a4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:40.512617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 374/752] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:40.514380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b46352-d711-41a7-9c9d-ec5192d9bf34 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:40.616766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:40.637095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b46352-d711-41a7-9c9d-ec5192d9bf34 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:40.651814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a407d-2172-4755-a325-e1f65f05b9a4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:40.693317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ba2c-ea74-450c-ab31-e2ac3ac635b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:40.694414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ba2c-ea74-450c-ab31-e2ac3ac635b5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.694714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ba2c-ea74-450c-ab31-e2ac3ac635b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.694995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ba2c-ea74-450c-ab31-e2ac3ac635b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.696091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ba2c-ea74-450c-ab31-e2ac3ac635b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:40.696408 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ba2c-ea74-450c-ab31-e2ac3ac635b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:40.698119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ba2c-ea74-450c-ab31-e2ac3ac635b5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:40.706126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:40.707356 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.707839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.708348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.709284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:40.710477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:40.712736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:40.720077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 375/753] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:40.720077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326490-196c-40e2-a357-2dcecc5f2886 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.720077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326490-196c-40e2-a357-2dcecc5f2886 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.720077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326490-196c-40e2-a357-2dcecc5f2886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.740019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 379/754] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:40.740019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:40.745909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e3326490-196c-40e2-a357-2dcecc5f2886 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:40.748108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e3326490-196c-40e2-a357-2dcecc5f2886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:40.766732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:40.825104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 376/755] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:40.826432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326490-196c-40e2-a357-2dcecc5f2886 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:40.852809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b004889-f2d7-4fe5-a92a-af0284d3a551 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:40.904846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:40.906495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:40.907459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:40.908228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:40.910260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=df857935a0644938938b7fd8c33eabf3) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:40.911155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:40.914875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:40.926631 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:40.937997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 380/756] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:40 2022] GET /identity/v3/role_assignments?user.id=df857935a0644938938b7fd8c33eabf3&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:40.939306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:40.961793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326490-196c-40e2-a357-2dcecc5f2886 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:41.004809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:41.006225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:41.006741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:41.007215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:41.008239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=f15a3709dbdf43efab86e3bed4977095) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:41.008784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:41.016288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:41.031557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 377/757] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:40 2022] GET /identity/v3/role_assignments?user.id=f15a3709dbdf43efab86e3bed4977095&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:41.124609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:41.137621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:41.156097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d92edf-bac6-4e25-9351-4003045d533d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:41.212726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664a83b-3d5a-4455-abda-df374ed578f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:41.213453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a83b-3d5a-4455-abda-df374ed578f2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:41.213845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a83b-3d5a-4455-abda-df374ed578f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:41.214163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a83b-3d5a-4455-abda-df374ed578f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:41.229968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664a83b-3d5a-4455-abda-df374ed578f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-e664a83b-3d5a-4455-abda-df374ed578f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:41.237142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:41.238192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:41.239378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:41.240012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 381/758] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:41.246585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664a83b-3d5a-4455-abda-df374ed578f2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:41.270183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65f2eb-6c88-4c89-a976-0495ae479121 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:41.315210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:41.316301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:41.316783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:41.317256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:41.318336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:41.320646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:41.342805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:41.343918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:41.344766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:41.348315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 378/759] 10.222.0.17 () {56 vars in 1129 bytes} [Mon Oct 3 12:25:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:41.354645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:41.365855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:41.394790 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664a83b-3d5a-4455-abda-df374ed578f2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:41.464575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:41.465219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:41.465463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:41.466303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:41.466978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:41.467966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:41.469424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:41.488504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 382/760] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:41.493983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:41.510208 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:41.548043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e9ef3-1103-422a-aef5-c46f8bef2943 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:41.616095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:41.616638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:41.616921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:41.617198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:41.617865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:41.618173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:41.619554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:41.634444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 379/761] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Oct 3 12:25:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:41.640282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:41.682514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f6b7c-1f86-4f8f-b7fd-d25063c317ab None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:41.748471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:41.763627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:41.764395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:41.764677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:41.764949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:41.785913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:41.787382 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:41.795727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fd748-12a7-41f1-a87e-f16f0dd04e26 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:41.804663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:41.805752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:41.807330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:41.807330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:41.807330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:41.807330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 383/762] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:41.811986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:41.845648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:41.846688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:41.847842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:41.848934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:41.849830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:41.851120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:41.853125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:41.862580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 380/763] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Oct 3 12:25:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:41.868797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:41.931322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:42.035630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148980a-61e5-4ce9-b350-76ba91247768 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:42.108993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:42.109748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:42.110051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:42.110402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:42.111055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:42.111361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:42.112754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:42.144120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 384/764] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:42.149923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:42.172365 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40bc75-5113-48a5-bda5-803eb63561de None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:42.206949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:42.215931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:42.216801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:42.217169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:42.217462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:42.218249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] RBAC: Adding query filter params (interface=public, service_id=0dfc16297ae6407b8d383a25b197ff76, region_id=RegionOne) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:42.219015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:42.220583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:42.229990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 381/765] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Oct 3 12:25:41 2022] GET /identity/v3/endpoints?service_id=0dfc16297ae6407b8d383a25b197ff76&interface=public®ion_id=RegionOne => generated 194 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:42.242217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:42.321296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47587-5bb9-40dd-bf88-c7a2faa2e770 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:42.348511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:42.359722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:42.360370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:42.360650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:42.360921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:42.375438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:42.376901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:42.400594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:42.401645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:42.402956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 385/766] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:25:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:42.408321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:42.471703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568aadf-fd96-47ae-8c28-92eb6935cbdf None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:42.545370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faba4f-94be-48db-b326-e5fefc513a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:42.546028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faba4f-94be-48db-b326-e5fefc513a86 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:42.546313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faba4f-94be-48db-b326-e5fefc513a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:42.546599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faba4f-94be-48db-b326-e5fefc513a86 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:42.547203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faba4f-94be-48db-b326-e5fefc513a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:42.548579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faba4f-94be-48db-b326-e5fefc513a86 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:42.559115 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 382/767] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:25:42 2022] GET /identity/v3/services => generated 772 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:42.561302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2342c7-507e-47d3-8e92-dd6cc351bb9f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:42.561886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2342c7-507e-47d3-8e92-dd6cc351bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:42.562356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2342c7-507e-47d3-8e92-dd6cc351bb9f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:42.567976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 383/768] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:42.570967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d88d-50fb-4196-8e89-6c72f6325269 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:42.571482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d88d-50fb-4196-8e89-6c72f6325269 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:42.571950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168d88d-50fb-4196-8e89-6c72f6325269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:42.610714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3168d88d-50fb-4196-8e89-6c72f6325269 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:42.612418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3168d88d-50fb-4196-8e89-6c72f6325269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:42.639184 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c726c-9f56-41cc-a58e-731bb740b09d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:42.679698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:42.697608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 384/769] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:42.727927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:42.728557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:42.728835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:42.729106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:42.729874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:42.730255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:42.732461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:42.764513 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 386/770] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:25:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:42.770168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d88d-50fb-4196-8e89-6c72f6325269 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:42.899329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168d88d-50fb-4196-8e89-6c72f6325269 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:42.938692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:42.939252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:42.939534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:42.939809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:42.951220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:42.952691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:42.969860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:42.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:42.971824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:42.971824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:42.971824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:42.971824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 385/771] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:42.976845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:43.020949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:43.043628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:43.090961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d3586-2b52-4210-96cd-603e02e4fe52 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:43.101179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:43.150921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:43.151543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.154375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.154741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.155413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:43.155723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:43.157117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:43.183647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 387/772] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:43.190220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:43.207269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4029a39-f33d-45b2-a329-d4cd2b432989 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:43.249015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:43.249681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.249961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.250231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.250818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:43.252182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:43.271831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:43.274241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:43.276248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 386/773] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:43 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:43.285449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:43.393949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:43.403952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639e9dd-1de4-43a3-a829-1899588623fc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:43.489064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419f785-227f-43a3-b519-287057054d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:43.489681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419f785-227f-43a3-b519-287057054d26 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.489965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419f785-227f-43a3-b519-287057054d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.490242 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419f785-227f-43a3-b519-287057054d26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.494721 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926e9f9-be85-4381-ae29-08995fadf0b9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:43.503086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:43.515457 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419f785-227f-43a3-b519-287057054d26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:43.516966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419f785-227f-43a3-b519-287057054d26 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-d419f785-227f-43a3-b519-287057054d26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:43.538498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:43.540645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:43.542780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:43.542780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:43.542780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:43.542780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:43.542780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:43.542780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:43.542780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:43.542780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:43.547027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 388/774] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:43.551872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419f785-227f-43a3-b519-287057054d26 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:43.570053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:43.573150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.573150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.573150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.573150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] RBAC: Adding query filter params (name=network) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:43.573150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:43.575792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:43.581675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 387/775] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:25:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:43.586833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:43.711983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419f785-227f-43a3-b519-287057054d26 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:43.726652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1800-cdc0-417c-9c79-5c7a19732f91 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:43.757956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b934b-5868-4584-8ffc-ca0eed48e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:43.758479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b934b-5868-4584-8ffc-ca0eed48e20f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.758765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b934b-5868-4584-8ffc-ca0eed48e20f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.759046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b934b-5868-4584-8ffc-ca0eed48e20f None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.759748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b934b-5868-4584-8ffc-ca0eed48e20f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:43.760065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b934b-5868-4584-8ffc-ca0eed48e20f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:43.761508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b934b-5868-4584-8ffc-ca0eed48e20f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:43.767452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:43.768069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.768343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.768610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.769239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] RBAC: Adding query filter params (type=network) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:43.769553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:43.770904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:43.781556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 389/776] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:43.781556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c108d4-b7bf-48c9-b6d4-8b98244f8c35 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.781556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c108d4-b7bf-48c9-b6d4-8b98244f8c35 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.781556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c108d4-b7bf-48c9-b6d4-8b98244f8c35 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.781556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 390/777] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:43.781556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2f21b-9347-4173-bc9c-4d02a9006e3b None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.782045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2f21b-9347-4173-bc9c-4d02a9006e3b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.782045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2f21b-9347-4173-bc9c-4d02a9006e3b None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.782173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 388/778] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:25:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:43.782173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:43.785385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 391/779] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:43.786296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2f21b-9347-4173-bc9c-4d02a9006e3b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:43.807554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:43.817896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:43.914329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3320-a148-4e40-8e5b-53fb75bfee8a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:43.918312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2f21b-9347-4173-bc9c-4d02a9006e3b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:43.958222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a7039-21ef-4416-9cec-34bc3edde80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:43.958848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7039-21ef-4416-9cec-34bc3edde80c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.959178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7039-21ef-4416-9cec-34bc3edde80c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.959458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7039-21ef-4416-9cec-34bc3edde80c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.960158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a7039-21ef-4416-9cec-34bc3edde80c None admin] RBAC: Adding query filter params (interface=public, service_id=5a88d7310ecd4456be0d060803c14f7c, region_id=RegionOne) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:43.960477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a7039-21ef-4416-9cec-34bc3edde80c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:43.961707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75c020-097b-4be5-81ca-5ead12088dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:43.961917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a7039-21ef-4416-9cec-34bc3edde80c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:43.962806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75c020-097b-4be5-81ca-5ead12088dd8 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.963290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75c020-097b-4be5-81ca-5ead12088dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.963795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75c020-097b-4be5-81ca-5ead12088dd8 None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/589b89539f8d43e993201fab13cd443a/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.967255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75c020-097b-4be5-81ca-5ead12088dd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=589b89539f8d43e993201fab13cd443a, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:43.970049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75c020-097b-4be5-81ca-5ead12088dd8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:43.970381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 392/780] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Oct 3 12:25:43 2022] GET /identity/v3/endpoints?service_id=5a88d7310ecd4456be0d060803c14f7c&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:43.971780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1abe-05ec-4e13-9727-62cf02da9cf5 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.972195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1abe-05ec-4e13-9727-62cf02da9cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.972596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb1abe-05ec-4e13-9727-62cf02da9cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:43.993554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 389/781] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:25:43 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/589b89539f8d43e993201fab13cd443a/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:25:43.995320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a4b09-2b82-4d42-b574-6e480d61f8e7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:43.995844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a4b09-2b82-4d42-b574-6e480d61f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:43.996351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a4b09-2b82-4d42-b574-6e480d61f8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:44.002974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-26fb1abe-05ec-4e13-9727-62cf02da9cf5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:44.004799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-26fb1abe-05ec-4e13-9727-62cf02da9cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:44.031260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2c0a4b09-2b82-4d42-b574-6e480d61f8e7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:44.033643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2c0a4b09-2b82-4d42-b574-6e480d61f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:44.089184 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 393/782] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:44.091016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb1abe-05ec-4e13-9727-62cf02da9cf5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:44.107370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:44.186493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 390/783] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:44.215137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb1abe-05ec-4e13-9727-62cf02da9cf5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:44.253988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5a3a-2764-42d5-a24f-5c3f08b5d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:44.254934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5a3a-2764-42d5-a24f-5c3f08b5d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:44.255410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5a3a-2764-42d5-a24f-5c3f08b5d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:44.255876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b5a3a-2764-42d5-a24f-5c3f08b5d6f2 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:44.256686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b5a3a-2764-42d5-a24f-5c3f08b5d6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:44.258282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b5a3a-2764-42d5-a24f-5c3f08b5d6f2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:44.264907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 394/784] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:25:44 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:44.449193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a4b09-2b82-4d42-b574-6e480d61f8e7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:44.493269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:44.574972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a4b09-2b82-4d42-b574-6e480d61f8e7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:44.612251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2262e7c-beaf-4a38-893c-2a24fd097a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:44.612898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2262e7c-beaf-4a38-893c-2a24fd097a75 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:44.613183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2262e7c-beaf-4a38-893c-2a24fd097a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:44.613461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2262e7c-beaf-4a38-893c-2a24fd097a75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:44.625330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2262e7c-beaf-4a38-893c-2a24fd097a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b2262e7c-beaf-4a38-893c-2a24fd097a75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:44.630258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:44.631245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:44.632522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:44.633227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5a3a-2764-42d5-a24f-5c3f08b5d6f2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:44.633311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 391/785] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:44.640339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2262e7c-beaf-4a38-893c-2a24fd097a75 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:44.773616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:44.801434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2262e7c-beaf-4a38-893c-2a24fd097a75 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:44.809923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:44.838879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:44.839112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b5a3a-2764-42d5-a24f-5c3f08b5d6f2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:44.839498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:44.839783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:44.840060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:44.841572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:44.841889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:44.843266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:44.853979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 392/786] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:44.860987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:44.919009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b375ff-408b-4f3c-80e0-9fb1c311d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:44.919658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b375ff-408b-4f3c-80e0-9fb1c311d79a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:44.919935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b375ff-408b-4f3c-80e0-9fb1c311d79a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:44.920209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b375ff-408b-4f3c-80e0-9fb1c311d79a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:44.945758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b375ff-408b-4f3c-80e0-9fb1c311d79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-25b375ff-408b-4f3c-80e0-9fb1c311d79a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:44.954023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:44.955028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:44.955859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:44.959678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 395/787] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:44.962326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b375ff-408b-4f3c-80e0-9fb1c311d79a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:45.046079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9c4ff-0f5c-47a7-a1e9-66c7a63952be None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:45.091177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:45.092779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.093273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.093570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.117141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:45.118700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:45.126558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:45.147272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:45.148299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:45.149189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:45.149189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:45.149189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:45.151527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 393/788] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:45.157035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:45.159410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b375ff-408b-4f3c-80e0-9fb1c311d79a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:45.203382 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:45.204052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.204335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.204720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.205301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:45.205631 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:45.207233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:45.213310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:45.219220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 396/789] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:45.224992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:45.334379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bc29e-ba23-4c2f-95c9-56377a49920a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:45.354157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d9438-5867-428c-9455-4b361c309abf None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:45.372024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d4b12-c069-4f8e-a9aa-58b6ca6be8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:45.372750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4b12-c069-4f8e-a9aa-58b6ca6be8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.373038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4b12-c069-4f8e-a9aa-58b6ca6be8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.373315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d4b12-c069-4f8e-a9aa-58b6ca6be8e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.373998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d4b12-c069-4f8e-a9aa-58b6ca6be8e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:45.374308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d4b12-c069-4f8e-a9aa-58b6ca6be8e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:45.375855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d4b12-c069-4f8e-a9aa-58b6ca6be8e5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:45.389697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 394/790] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:45.390252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:45.391012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.391119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080412d-0447-46b1-bfba-1ddcc04f9f3c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.391205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.391279 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080412d-0447-46b1-bfba-1ddcc04f9f3c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.391464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.391567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080412d-0447-46b1-bfba-1ddcc04f9f3c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.393063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 395/791] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:45.401397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db3813-4299-4c92-9042-b9abf798b750 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.401901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db3813-4299-4c92-9042-b9abf798b750 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.402343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db3813-4299-4c92-9042-b9abf798b750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.402531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:45.404623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:45.421400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:45.422656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:45.423891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:45.423891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:45.423891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:45.423891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 397/792] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:45.423891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:45.426490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e9db3813-4299-4c92-9042-b9abf798b750 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:45.428010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e9db3813-4299-4c92-9042-b9abf798b750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:45.492206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:45.494729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:45.516536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 396/793] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:45.516536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db3813-4299-4c92-9042-b9abf798b750 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:45.597267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcfae17-3018-497d-a556-0d9618277db5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:45.662218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:45.663681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.664431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.664911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.689303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:45.694313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:45.714913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db3813-4299-4c92-9042-b9abf798b750 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:45.718553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:45.719509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:25:45.720479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:45.735622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 398/794] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:25:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:45.752072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:45.793147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:45.793859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.794142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.794412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.795076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:45.795383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:45.796788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:45.819158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 397/795] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:45.825557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:45.895244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30945a83-ec0b-4944-8571-63c8dc51c78e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:45.895787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:45.907636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:45.935169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:45.936313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:45.936855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:45.937337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:45.938420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:45.938943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:45.940659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:45.965551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efdeb-3f98-43a9-bfdc-00e74a274532 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:45.966108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 399/796] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Oct 3 12:25:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:45.967126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.005825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.006562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.006897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.007236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.018427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.020274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:46.036994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:46.038204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:46.039176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 398/797] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:46.039786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.091121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6559a-b72c-48f3-8c0b-ad5adcb27bf6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.137937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.138585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.138858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.139125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.139714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.141088 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.159655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0847-4a78-4a90-b45b-120540d1cff3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:46.160383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:46.161395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 03 12:25:46.162293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:46.163728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 400/798] 10.222.0.17 () {56 vars in 1129 bytes} [Mon Oct 3 12:25:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:46.165598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.174585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:46.210477 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.211162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.211445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.211717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.213473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:46.225872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.227880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:46.247209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:46.248234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:46.249151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:46.249151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:46.249151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:46.252992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 399/799] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:46.254222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.301027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fc8e6-52d0-419a-a3a5-db4c5a493e0d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.337907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.338521 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.339066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.339066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.339793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:46.340720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.342171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.362226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 401/800] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:46.363279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.388921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e604a3-b85f-4016-b80f-285d555fde90 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.433619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.434608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.435365 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.435834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.437291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:46.437828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.439745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.445381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 400/801] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:46.446595 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.463359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:46.475485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d39c7-adca-4f7e-be56-eaacf75aa1c1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.479339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:46.524628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.526275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.526738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.527222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.529302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:46.530104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.531695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.548516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 402/802] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:46.549689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.586446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9336604-f512-4abe-86d2-b04e2a7006d8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.631611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.632777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.632777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.632777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.645140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.646656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:46.663478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:46.664512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:46.665399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:46.665399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:46.665399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:46.669759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 401/803] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:46.671574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.673871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67798a9d-50c3-4ccb-a8f5-87e9e810b230 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.728645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9ac03-8432-4cad-b1e4-02ede3e37322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.729378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ac03-8432-4cad-b1e4-02ede3e37322 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.729747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ac03-8432-4cad-b1e4-02ede3e37322 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.730111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9ac03-8432-4cad-b1e4-02ede3e37322 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.730859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9ac03-8432-4cad-b1e4-02ede3e37322 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:46.731567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9ac03-8432-4cad-b1e4-02ede3e37322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.732630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9ac03-8432-4cad-b1e4-02ede3e37322 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.745605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 403/804] 10.222.0.17 () {56 vars in 1124 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:46.745605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654ad0b-218a-4146-b2a1-08e0db44cae3 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.745605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654ad0b-218a-4146-b2a1-08e0db44cae3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.745605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654ad0b-218a-4146-b2a1-08e0db44cae3 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.745605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 404/805] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:46.745605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654ad0b-218a-4146-b2a1-08e0db44cae3 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.765344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:46.782538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:46.818656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b613f3b-c48e-4b02-be8f-3b6113a04382 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.861628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71846872-4a59-4df3-939f-4b6ecdac7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.862576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71846872-4a59-4df3-939f-4b6ecdac7bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.862853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71846872-4a59-4df3-939f-4b6ecdac7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.863125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71846872-4a59-4df3-939f-4b6ecdac7bb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.870774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71846872-4a59-4df3-939f-4b6ecdac7bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.872271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71846872-4a59-4df3-939f-4b6ecdac7bb7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.882828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654ad0b-218a-4146-b2a1-08e0db44cae3 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-71846872-4a59-4df3-939f-4b6ecdac7bb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:46.884359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:46.885580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 402/806] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6cfde-6694-42d0-9af7-8dfd35168971 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.887919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6cfde-6694-42d0-9af7-8dfd35168971 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.889022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6cfde-6694-42d0-9af7-8dfd35168971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.908028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e2a6cfde-6694-42d0-9af7-8dfd35168971 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:46.909224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e2a6cfde-6694-42d0-9af7-8dfd35168971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:46.928844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:46.929712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.929712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.929994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.930631 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:46.930932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:46.932307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:46.944158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 405/807] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:46.945047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:46.983823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 403/808] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:46.985018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dde7e-15a1-4c3d-a577-4c7c1611e6e8 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:46.985310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dde7e-15a1-4c3d-a577-4c7c1611e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:46.985688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dde7e-15a1-4c3d-a577-4c7c1611e6e8 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:46.987041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 404/809] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:46.987608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dde7e-15a1-4c3d-a577-4c7c1611e6e8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:47.034167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:47.061194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:47.064523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7a339-9a07-47a3-a535-4ce8b90782b3 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:47.103097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cbc04-403e-4c6e-b36e-ff304befe7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:47.103880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cbc04-403e-4c6e-b36e-ff304befe7fb None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:47.104084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cbc04-403e-4c6e-b36e-ff304befe7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:47.104409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cbc04-403e-4c6e-b36e-ff304befe7fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:47.105042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dde7e-15a1-4c3d-a577-4c7c1611e6e8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:47.105195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cbc04-403e-4c6e-b36e-ff304befe7fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:47.106564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cbc04-403e-4c6e-b36e-ff304befe7fb None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:47.134722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 406/810] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:25:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:47.136857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cbc04-403e-4c6e-b36e-ff304befe7fb None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:47.171349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf6b02-d473-4cab-9ba6-481df36d953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:47.172336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6b02-d473-4cab-9ba6-481df36d953f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:47.172833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6b02-d473-4cab-9ba6-481df36d953f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:47.173291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6b02-d473-4cab-9ba6-481df36d953f None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:47.174234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6b02-d473-4cab-9ba6-481df36d953f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:47.174733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6b02-d473-4cab-9ba6-481df36d953f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:47.176565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6b02-d473-4cab-9ba6-481df36d953f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:47.193573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 405/811] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:47.195604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76c103-db67-4a47-8366-6dc8f85e816e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:47.196122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76c103-db67-4a47-8366-6dc8f85e816e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:47.196594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76c103-db67-4a47-8366-6dc8f85e816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:47.234565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7b76c103-db67-4a47-8366-6dc8f85e816e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:47.235737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7b76c103-db67-4a47-8366-6dc8f85e816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:47.283857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cbc04-403e-4c6e-b36e-ff304befe7fb None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:47.318792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:47.326706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:47.327468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:47.327768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:47.328218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:47.333632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 406/812] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:47.334795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76c103-db67-4a47-8366-6dc8f85e816e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:47.343140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:47.344775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:47.358692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:47.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:47.360566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 407/813] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:47.361052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:47.406710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:47.497642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76c103-db67-4a47-8366-6dc8f85e816e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:47.512159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38db8fc-d62c-457e-a794-1a61f3d06387 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:47.531220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887508-ecd7-4d05-90e1-66b946d9cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:47.532001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887508-ecd7-4d05-90e1-66b946d9cf3d None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:47.532283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887508-ecd7-4d05-90e1-66b946d9cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:47.532613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887508-ecd7-4d05-90e1-66b946d9cf3d None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/df857935a0644938938b7fd8c33eabf3/roles/8620609e2f8a4b039384fd7a3d24253d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:47.551333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2887508-ecd7-4d05-90e1-66b946d9cf3d None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=df857935a0644938938b7fd8c33eabf3, role_id=8620609e2f8a4b039384fd7a3d24253d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:47.552861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2887508-ecd7-4d05-90e1-66b946d9cf3d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:47.555283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a3da5-0a01-46ea-9dce-69aeee420a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:47.556241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a3da5-0a01-46ea-9dce-69aeee420a30 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:47.556679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a3da5-0a01-46ea-9dce-69aeee420a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:47.557118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a3da5-0a01-46ea-9dce-69aeee420a30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:47.570382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 407/814] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:25:47 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/df857935a0644938938b7fd8c33eabf3/roles/8620609e2f8a4b039384fd7a3d24253d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:25:47.570601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a3da5-0a01-46ea-9dce-69aeee420a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:47.571921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887508-ecd7-4d05-90e1-66b946d9cf3d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-c63a3da5-0a01-46ea-9dce-69aeee420a30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:47.577409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:47.578484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:47.579341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 408/815] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:47.586647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a3da5-0a01-46ea-9dce-69aeee420a30 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:47.697203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:47.720447 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:47.725962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887508-ecd7-4d05-90e1-66b946d9cf3d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:47.784161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a3da5-0a01-46ea-9dce-69aeee420a30 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:47.786878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:47.787523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:47.787805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:47.788078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:47.788786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:47.789101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:47.790582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:47.807241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 408/816] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:47.808453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:47.830290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:47.830916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:47.832112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:47.832392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:47.833079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:47.833383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:47.834840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:47.844935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 409/817] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:47.845921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:47.942105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86948e90-2fc8-432c-850a-65d576d206da None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:47.994743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b9b2-a3cf-4a5a-af68-be302eb079ae None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:48.008207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.009919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.010542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.010927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.011621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.013229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:48.015738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:48.023946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:48.025218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 03 12:25:48.026345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:48.028826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 409/818] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:47 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:48.030207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:48.044242 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3d29-0bac-42b5-a5a7-918410593806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.045297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3d29-0bac-42b5-a5a7-918410593806 None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.046056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3d29-0bac-42b5-a5a7-918410593806 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.046573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3d29-0bac-42b5-a5a7-918410593806 None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/f15a3709dbdf43efab86e3bed4977095/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.049207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec3d29-0bac-42b5-a5a7-918410593806 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=f15a3709dbdf43efab86e3bed4977095, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.050913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec3d29-0bac-42b5-a5a7-918410593806 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:48.061126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:48.072127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 410/819] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:25:47 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/f15a3709dbdf43efab86e3bed4977095/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:25:48.074769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3d29-0bac-42b5-a5a7-918410593806 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:48.205552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd08919-de5e-4855-9ef3-e56c0091a5d8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:48.250410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.251376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.251817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.252575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.266390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.268233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:48.286839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:48.288045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:48.289169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:48.289169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:48.289169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:48.291230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 410/820] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:48.299749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:48.318392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3d29-0bac-42b5-a5a7-918410593806 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:48.363757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.364874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.365258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.365737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.366687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] RBAC: Adding query filter params (name=network) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:48.367281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.368904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:48.375325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 411/821] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:25:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:48.380835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:48.443872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:48.470898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:48.500674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63162b56-2905-43c5-a734-d48a3131900e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:48.536825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ab420-c1e7-4be7-b83c-f9d00c51efba None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:48.543755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.544629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.545058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.545486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.546424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:48.546877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.548532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:48.562955 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 411/822] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:48.571745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:48.585840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.586709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.587091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.587562 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.588208 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:48.588619 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.590882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:48.596860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 412/823] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:25:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:48.602716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:48.695917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49142bf-0342-42a1-a055-453f9b04989d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:48.736351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.737769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.738305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.739007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.747331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.748299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:48.750511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:48.771630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:48.772841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:25:48.774069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:48.782058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 412/824] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:25:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:48.787106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:48.874665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:48.884384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28964f8-c2f2-4e9b-b252-970b138071b7 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:48.922733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc8066-9750-4c06-9c44-61530f98d08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.923348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8066-9750-4c06-9c44-61530f98d08c None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.923625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8066-9750-4c06-9c44-61530f98d08c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.923897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc8066-9750-4c06-9c44-61530f98d08c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.924693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc8066-9750-4c06-9c44-61530f98d08c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.926334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc8066-9750-4c06-9c44-61530f98d08c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:48.927911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906549e9-a504-4121-b7b9-7cec4d77bcd5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:48.952716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 413/825] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:25:48 2022] POST /identity/v3/endpoints => generated 337 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:48.987947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:48.988843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:48.989121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:48.989396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:48.990281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:48.990587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:48.992081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:49.013434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 413/826] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:25:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:49.022803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc8066-9750-4c06-9c44-61530f98d08c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:49.151670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc8066-9750-4c06-9c44-61530f98d08c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:49.204032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26632262-1036-4633-a16f-e3a85291d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:49.204714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26632262-1036-4633-a16f-e3a85291d13a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:49.205083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26632262-1036-4633-a16f-e3a85291d13a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:49.205357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26632262-1036-4633-a16f-e3a85291d13a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:49.245548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:49.321499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26632262-1036-4633-a16f-e3a85291d13a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:49.323087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26632262-1036-4633-a16f-e3a85291d13a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:49.440622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 414/827] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:25:49.450846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:49.513856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:49.579076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f24f87-326b-47e0-a5a8-213868d33c72 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:49.619133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d65d6-c605-4798-ab20-d4935ab60163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:49.619820 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d65d6-c605-4798-ab20-d4935ab60163 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:49.620101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d65d6-c605-4798-ab20-d4935ab60163 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:49.620425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d65d6-c605-4798-ab20-d4935ab60163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:49.633291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d65d6-c605-4798-ab20-d4935ab60163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:49.634898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d65d6-c605-4798-ab20-d4935ab60163 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-123d65d6-c605-4798-ab20-d4935ab60163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:49.653024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:49.654093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:49.655884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:49.655884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:49.655884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:49.655884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 414/828] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:49.660149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26632262-1036-4633-a16f-e3a85291d13a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:49.730948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:49.778564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26632262-1036-4633-a16f-e3a85291d13a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:49.803844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38855b7-67e3-44c0-9f54-49077bf078ec None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:49.804369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38855b7-67e3-44c0-9f54-49077bf078ec None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:49.804447 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38855b7-67e3-44c0-9f54-49077bf078ec None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:49.806235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 415/829] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:25:49.812409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ff681-3684-4a3e-a06d-2eed6333c3d7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:49.812693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ff681-3684-4a3e-a06d-2eed6333c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:49.812970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ff681-3684-4a3e-a06d-2eed6333c3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:49.816785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:49.817405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:49.817712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:49.817985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:49.818629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:49.818932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:49.820559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:49.832048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a81ff681-3684-4a3e-a06d-2eed6333c3d7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:49.832983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 415/830] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:49.833250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a81ff681-3684-4a3e-a06d-2eed6333c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:49.842651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:49.922848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 416/831] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:25:49.981628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e70c11-f11d-45a1-baaf-ca63792e1013 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:50.001090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:50.028027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c30c48-a658-442a-9afc-6beb7237b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:50.028813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30c48-a658-442a-9afc-6beb7237b42d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.028995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30c48-a658-442a-9afc-6beb7237b42d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.029232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c30c48-a658-442a-9afc-6beb7237b42d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.036978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c30c48-a658-442a-9afc-6beb7237b42d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:50.038459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c30c48-a658-442a-9afc-6beb7237b42d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-b8c30c48-a658-442a-9afc-6beb7237b42d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:50.051603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:50.052536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:50.053422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 416/832] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:50.060814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ff681-3684-4a3e-a06d-2eed6333c3d7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:50.099842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:50.176933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ff681-3684-4a3e-a06d-2eed6333c3d7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:50.201912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a05b-f8f2-42fa-b272-c39ff26e5765 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.202580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a05b-f8f2-42fa-b272-c39ff26e5765 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.203272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a05b-f8f2-42fa-b272-c39ff26e5765 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.205933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 417/833] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:50.218351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269930ea-7f26-4230-a7bb-9f5ce196c770 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.218787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269930ea-7f26-4230-a7bb-9f5ce196c770 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.219284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269930ea-7f26-4230-a7bb-9f5ce196c770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.223129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:50.223750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.224031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.224304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.225005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:50.225416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:50.226877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:50.239810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-269930ea-7f26-4230-a7bb-9f5ce196c770 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:50.241555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 417/834] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:50.241680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-269930ea-7f26-4230-a7bb-9f5ce196c770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:50.241760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:50.319262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 418/835] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:50.320472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269930ea-7f26-4230-a7bb-9f5ce196c770 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:50.337982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:50.356155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98dc33-06bc-437d-81fa-0b34ed3071ba None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:50.395678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:50.396712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.397218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.397726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.398638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:50.400217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:50.411123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:50.412168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:25:50.413020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:50.421151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 418/836] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:25:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:50.422379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:50.457215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269930ea-7f26-4230-a7bb-9f5ce196c770 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:50.467624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:50.507173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:50.507792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.508142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.508483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.509274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=589b89539f8d43e993201fab13cd443a) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:50.509683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:50.511306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:50.520706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 419/837] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:50 2022] GET /identity/v3/role_assignments?user.id=589b89539f8d43e993201fab13cd443a&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:50.547682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fdc46-2b3b-4049-b05d-d066eb9b6b38 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:50.589112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:50.590493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.590842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.591120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.591765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:50.592069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:50.593620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:50.599480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 419/838] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:25:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:50.606741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:50.637637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:50.666109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:50.738880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bdf32-74c9-4cba-98f0-29cf61343967 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:50.767338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14fc7f-c7f9-49e0-a8e3-96e61c8a956b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:50.787964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec147-8e34-458c-9edd-f7788dba1fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:50.788866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec147-8e34-458c-9edd-f7788dba1fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.789304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec147-8e34-458c-9edd-f7788dba1fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.789618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec147-8e34-458c-9edd-f7788dba1fe3 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.790251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec147-8e34-458c-9edd-f7788dba1fe3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:50.790555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec147-8e34-458c-9edd-f7788dba1fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:50.791979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec147-8e34-458c-9edd-f7788dba1fe3 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:50.797026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 420/839] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:25:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:50.798345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485456-1fbb-4424-9c67-920e8ac6acdc None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.798632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485456-1fbb-4424-9c67-920e8ac6acdc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.798904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485456-1fbb-4424-9c67-920e8ac6acdc None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.800553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 421/840] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:50.806965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea166293-bdf2-41a1-b9c8-c0c009be124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:50.807517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79baff3-64bc-4d39-ba8e-0ef37160faba None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.807655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea166293-bdf2-41a1-b9c8-c0c009be124f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:50.807750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79baff3-64bc-4d39-ba8e-0ef37160faba None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.807825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea166293-bdf2-41a1-b9c8-c0c009be124f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:50.807896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79baff3-64bc-4d39-ba8e-0ef37160faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.807973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea166293-bdf2-41a1-b9c8-c0c009be124f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:50.822011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea166293-bdf2-41a1-b9c8-c0c009be124f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ea166293-bdf2-41a1-b9c8-c0c009be124f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:50.828867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:50.829976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:50.831338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 420/841] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:50.832358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e79baff3-64bc-4d39-ba8e-0ef37160faba None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:50.832358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e79baff3-64bc-4d39-ba8e-0ef37160faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:50.838214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea166293-bdf2-41a1-b9c8-c0c009be124f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:50.880909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:50.933036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 422/842] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:25:50.950230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:50.973827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea166293-bdf2-41a1-b9c8-c0c009be124f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:51.013865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:51.014492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:51.014773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:51.015046 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:51.015730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:51.016034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:51.017481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:51.027196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 421/843] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:51.033548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79baff3-64bc-4d39-ba8e-0ef37160faba None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.171086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79baff3-64bc-4d39-ba8e-0ef37160faba None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:51.211498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.225500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:51.226557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:51.227138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:51.227578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:51.245656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:51.247964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:51.267142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:51.268256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:51.269806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:51.269806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:51.269806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:51.269806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 423/844] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:51.274534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.298170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:51.337297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c45ed-4281-442b-b790-78beb8006065 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:51.379884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b04b-3c81-4c7b-b56e-6a5198ae6a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:51.380907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b04b-3c81-4c7b-b56e-6a5198ae6a34 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:51.381410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b04b-3c81-4c7b-b56e-6a5198ae6a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:51.381931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b04b-3c81-4c7b-b56e-6a5198ae6a34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:51.393801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3b04b-3c81-4c7b-b56e-6a5198ae6a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1dd3b04b-3c81-4c7b-b56e-6a5198ae6a34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:51.399390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:51.400341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:25:51.401163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:51.409021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41815fa-634f-4c91-95e5-cc3e122816cc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:51.409212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 422/845] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:51.410732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b04b-3c81-4c7b-b56e-6a5198ae6a34 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.414055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:51.459291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:51.459914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:51.460197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:51.460477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:51.461618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:51.461935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:51.463627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:51.484846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 424/846] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:51.486543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.533241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b04b-3c81-4c7b-b56e-6a5198ae6a34 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:51.575993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:51.577164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:51.577706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:51.578131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:51.578953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:51.579681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:51.582119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:51.593217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:51.595507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 423/847] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:51.602928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.626349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ff8f8-85f3-4a0d-9fdf-3e8d1b6f5cf6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:51.663949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:51.664976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:51.665128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:51.665504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:51.674421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:51.676044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:51.688658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:51.689917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:25:51.690913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:51.699518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 425/848] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:51.702597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:51.703432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.759996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62fe0-024c-495f-b8be-9cd9e4bd5dc4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:51.812500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:51.814064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:51.814976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:51.815425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:51.831228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:51.833757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:51.836542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de331a7a-cf89-4ca3-ab49-f368fa9ddf23 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:51.856764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:51.857809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:51.858691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:51.858691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:51.858691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:51.861300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 424/849] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:51.868114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.885207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:51.887171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:51.887954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:51.888438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:51.889546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:51.890360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:51.892012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:51.896045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:51.921545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 426/850] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:51.923083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:51.987067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609a11a-850e-439c-8ece-8ea23147a7bd None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.005887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:52.028033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.029300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.029800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.030214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.031038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:52.031668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:52.033394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:52.052078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd993c-2683-4ee0-857c-098ae239341c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.052909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 425/851] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:52.054404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:52.094362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51bba7-fb8b-4e40-aae5-4b19253269a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.094888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51bba7-fb8b-4e40-aae5-4b19253269a2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.095192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51bba7-fb8b-4e40-aae5-4b19253269a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.095516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51bba7-fb8b-4e40-aae5-4b19253269a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.169933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5af88-ca2c-4054-91b6-121e06fbc2c4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.195452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:52.204847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51bba7-fb8b-4e40-aae5-4b19253269a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:52.206674 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51bba7-fb8b-4e40-aae5-4b19253269a2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:52.210909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.211515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.211795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.212135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.222029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:52.223568 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:52.237293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:52.238582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 03 12:25:52.239516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:52.243701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 426/852] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:25:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:52.245226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:52.284016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:52.321639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 427/853] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:25:52.324312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51bba7-fb8b-4e40-aae5-4b19253269a2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:52.361244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2c743-548d-4df9-bbaa-3e06e55d25c4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.402594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.403143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.403422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.403747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.404491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:52.404800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:52.406373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:52.433720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 427/854] 10.222.0.17 () {56 vars in 1135 bytes} [Mon Oct 3 12:25:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:52.434038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:52.437274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:52.438868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51bba7-fb8b-4e40-aae5-4b19253269a2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.483792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.485214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.485924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.486605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.504482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:52.506415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:52.527571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:52.528590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:52.529475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:52.529475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:52.529475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:52.535987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 428/855] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:52.537641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:52.550692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:52.560769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4eb8fa-e402-4a48-94f4-79565e28bc14 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.600507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b6b29-349a-4d9f-be01-aa36f0fc01b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.601156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b6b29-349a-4d9f-be01-aa36f0fc01b4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.601433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b6b29-349a-4d9f-be01-aa36f0fc01b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.601736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b6b29-349a-4d9f-be01-aa36f0fc01b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.671324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bd13-3c04-4aee-aeca-f9e6e4469e2a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.679311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b6b29-349a-4d9f-be01-aa36f0fc01b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:52.680806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b6b29-349a-4d9f-be01-aa36f0fc01b4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:52.722065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.723625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.724214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.724773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.725703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:52.726204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:52.729180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:52.751572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 429/856] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:52.753353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:52.766452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:52.800837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:52.816290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 428/857] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:52 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:25:52.818339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b6b29-349a-4d9f-be01-aa36f0fc01b4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:52.894931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde3e35-99a2-4a56-8d05-600fa2ca1561 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.935910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694f1e8-afee-43cb-821c-f92d3adad229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.936470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694f1e8-afee-43cb-821c-f92d3adad229 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.936756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694f1e8-afee-43cb-821c-f92d3adad229 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.937031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694f1e8-afee-43cb-821c-f92d3adad229 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.944150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694f1e8-afee-43cb-821c-f92d3adad229 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:52.945632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694f1e8-afee-43cb-821c-f92d3adad229 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:52.947402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b6b29-349a-4d9f-be01-aa36f0fc01b4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-2694f1e8-afee-43cb-821c-f92d3adad229 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:52.958665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:52.959700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 430/858] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54466862-f7bc-4e5c-8874-ac0208124d62 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.961825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54466862-f7bc-4e5c-8874-ac0208124d62 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.962452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54466862-f7bc-4e5c-8874-ac0208124d62 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.968577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 431/859] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:52.970045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7772b1-aed0-4413-9a97-af46bf3b5fab None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:52.970333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7772b1-aed0-4413-9a97-af46bf3b5fab None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:52.970607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7772b1-aed0-4413-9a97-af46bf3b5fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:52.990121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2f7772b1-aed0-4413-9a97-af46bf3b5fab None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:52.991218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2f7772b1-aed0-4413-9a97-af46bf3b5fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:52.998664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:52.999745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.000041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.000319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.014189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.016179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:53.032643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:53.033842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:53.034896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:53.034896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:53.034896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:53.038504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 429/860] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:53.039318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.059702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:53.069741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 432/861] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:53.078730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7772b1-aed0-4413-9a97-af46bf3b5fab None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.100373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:53.174261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bd6e4-dec6-43c8-867b-4c518c1873d4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:53.211227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7772b1-aed0-4413-9a97-af46bf3b5fab None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:53.213466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a31cb-05f9-4a85-a248-3d52b6f6626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:53.215050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a31cb-05f9-4a85-a248-3d52b6f6626e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.215334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a31cb-05f9-4a85-a248-3d52b6f6626e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.215619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a31cb-05f9-4a85-a248-3d52b6f6626e None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.216324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a31cb-05f9-4a85-a248-3d52b6f6626e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:53.216638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a31cb-05f9-4a85-a248-3d52b6f6626e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.218108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a31cb-05f9-4a85-a248-3d52b6f6626e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.238733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 430/862] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:53.238733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de29ed-c6ce-4402-890c-70edced03cbe None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.238733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de29ed-c6ce-4402-890c-70edced03cbe None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.238733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de29ed-c6ce-4402-890c-70edced03cbe None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.238733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 431/863] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:53.241355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de29ed-c6ce-4402-890c-70edced03cbe None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.253688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69038d39-6e56-41bd-8f40-87e14c6026ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:53.254310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038d39-6e56-41bd-8f40-87e14c6026ab None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.254588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038d39-6e56-41bd-8f40-87e14c6026ab None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.254869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038d39-6e56-41bd-8f40-87e14c6026ab None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.255574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038d39-6e56-41bd-8f40-87e14c6026ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:53.255879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038d39-6e56-41bd-8f40-87e14c6026ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.257312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038d39-6e56-41bd-8f40-87e14c6026ab None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.276029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 433/864] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:53.276029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f0804-c48b-42e3-a729-85e8e807260f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.276029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f0804-c48b-42e3-a729-85e8e807260f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.276029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f0804-c48b-42e3-a729-85e8e807260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.295726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2f4f0804-c48b-42e3-a729-85e8e807260f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:53.297362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2f4f0804-c48b-42e3-a729-85e8e807260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:53.356741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:53.362387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de29ed-c6ce-4402-890c-70edced03cbe None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:53.371131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:53.375637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 434/865] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:53.376475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f0804-c48b-42e3-a729-85e8e807260f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.402340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:53.403418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.403821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.404096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.404818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=df857935a0644938938b7fd8c33eabf3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:53.405126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.406581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.413280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 432/866] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/role_assignments?user.id=df857935a0644938938b7fd8c33eabf3&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:53.413280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.507615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f0804-c48b-42e3-a729-85e8e807260f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:53.549095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:53.549833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.550115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.550459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.559430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c23ab0-fef2-4957-af26-7c55d22614d3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:53.559674 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.561112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:53.573933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:53.575205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:53.576461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:53.576461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:53.576461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:53.576461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:53.576461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:53.576461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:53.576461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:53.576461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:53.580097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 435/867] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:53.581071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.608503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:53.609691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.610081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.610919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.611639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.613752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:53.626597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:53.627915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:25:53.629012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:53.632526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 433/868] 10.222.0.17 () {56 vars in 1132 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:53.637364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.650493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:53.680632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:53.724993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6063b27-83a8-46b4-8957-3bc2c0c85e55 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:53.762833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:53.763378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.763658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.763938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.764641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:53.764952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.766432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.776340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe515-fde5-43d6-a2e8-b996803b406d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:53.779534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 436/869] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:53.780211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.822040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:53.822627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.822713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.822966 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.823564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:53.823872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.825235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.834965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 434/870] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:53.834965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.897780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fd902-3c86-42af-8343-6f832e18b1ae None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:53.906392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:53.939484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ed48-e4c0-409b-97ec-72e4708e8600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:53.940112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ed48-e4c0-409b-97ec-72e4708e8600 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:53.940392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ed48-e4c0-409b-97ec-72e4708e8600 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:53.941127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ed48-e4c0-409b-97ec-72e4708e8600 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:53.941840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563ed48-e4c0-409b-97ec-72e4708e8600 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:53.943714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563ed48-e4c0-409b-97ec-72e4708e8600 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:53.962657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:53.976300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 437/871] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:25:53 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:53.976300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ed48-e4c0-409b-97ec-72e4708e8600 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:53.976618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a46edf-8eb8-465b-bf1a-360f06bb8972 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:54.017395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246297dd-8bdb-49e8-8d87-5698d18f846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:54.018019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246297dd-8bdb-49e8-8d87-5698d18f846c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:54.018305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246297dd-8bdb-49e8-8d87-5698d18f846c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:54.018687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246297dd-8bdb-49e8-8d87-5698d18f846c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:54.020796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246297dd-8bdb-49e8-8d87-5698d18f846c None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=f15a3709dbdf43efab86e3bed4977095) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:54.021135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246297dd-8bdb-49e8-8d87-5698d18f846c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:54.022881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246297dd-8bdb-49e8-8d87-5698d18f846c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:54.041996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 435/872] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/role_assignments?user.id=f15a3709dbdf43efab86e3bed4977095&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:54.112032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ed48-e4c0-409b-97ec-72e4708e8600 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:54.155924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b26297-544e-4bf4-bbb8-fa839694be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:54.156565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b26297-544e-4bf4-bbb8-fa839694be7e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:54.156849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b26297-544e-4bf4-bbb8-fa839694be7e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:54.157123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b26297-544e-4bf4-bbb8-fa839694be7e None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:54.157815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b26297-544e-4bf4-bbb8-fa839694be7e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:54.158123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b26297-544e-4bf4-bbb8-fa839694be7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:54.159549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b26297-544e-4bf4-bbb8-fa839694be7e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:54.169622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 438/873] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:25:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:55.804444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e23b-ad51-46ff-ad55-655a900164d6 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:55.804964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e23b-ad51-46ff-ad55-655a900164d6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:55.804964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e23b-ad51-46ff-ad55-655a900164d6 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:55.806588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 436/874] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:55.812737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27212088-3e63-4d91-b6ab-3827be832778 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:55.813215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27212088-3e63-4d91-b6ab-3827be832778 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:55.813297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27212088-3e63-4d91-b6ab-3827be832778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:55.831806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-27212088-3e63-4d91-b6ab-3827be832778 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:55.832979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-27212088-3e63-4d91-b6ab-3827be832778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:55.858646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:55.911267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 439/875] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:55 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:56.182059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e23b-ad51-46ff-ad55-655a900164d6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:56.290910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdde39-e11c-4fb5-a731-1089306bc88f None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.291325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdde39-e11c-4fb5-a731-1089306bc88f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.291503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdde39-e11c-4fb5-a731-1089306bc88f None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.295312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 440/876] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:25:56.300190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c11c7f-8c9a-42d8-9dba-c718a1019798 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.300484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c11c7f-8c9a-42d8-9dba-c718a1019798 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.300742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c11c7f-8c9a-42d8-9dba-c718a1019798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.302840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e23b-ad51-46ff-ad55-655a900164d6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:56.321299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-39c11c7f-8c9a-42d8-9dba-c718a1019798 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:56.322644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-39c11c7f-8c9a-42d8-9dba-c718a1019798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:56.340182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09240-1ddb-4cb9-9cf6-0cdbbcf6cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:56.340828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09240-1ddb-4cb9-9cf6-0cdbbcf6cac9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.341104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09240-1ddb-4cb9-9cf6-0cdbbcf6cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.341376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09240-1ddb-4cb9-9cf6-0cdbbcf6cac9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.352754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09240-1ddb-4cb9-9cf6-0cdbbcf6cac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-12e09240-1ddb-4cb9-9cf6-0cdbbcf6cac9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:25:56.358243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:56.359199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:56.360058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 437/877] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Oct 3 12:25:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:56.366059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09240-1ddb-4cb9-9cf6-0cdbbcf6cac9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:56.385892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:56.402586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 441/878] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:25:56.404003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b67c-52e3-46af-aa44-a27a79909e75 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.404295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b67c-52e3-46af-aa44-a27a79909e75 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.404570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993b67c-52e3-46af-aa44-a27a79909e75 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.405991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 442/879] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:56.412215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f8254-1c74-4a3a-81eb-69fda5b975e6 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.412496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f8254-1c74-4a3a-81eb-69fda5b975e6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.412767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f8254-1c74-4a3a-81eb-69fda5b975e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.435501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-c03f8254-1c74-4a3a-81eb-69fda5b975e6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:56.436808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c03f8254-1c74-4a3a-81eb-69fda5b975e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:56.482744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09240-1ddb-4cb9-9cf6-0cdbbcf6cac9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:56.509157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 443/880] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:25:56.510471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fcb9-e4c7-4498-b5bd-3f222b3c486c None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.510759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fcb9-e4c7-4498-b5bd-3f222b3c486c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.511031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46fcb9-e4c7-4498-b5bd-3f222b3c486c None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.516508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 444/881] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:56.517714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062ecb7-da04-4af4-a2ce-9d850480aab9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.517966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062ecb7-da04-4af4-a2ce-9d850480aab9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.518244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062ecb7-da04-4af4-a2ce-9d850480aab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.522990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:56.523928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.524618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.525829 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.526606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:56.526916 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:56.528290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:56.539955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f062ecb7-da04-4af4-a2ce-9d850480aab9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:56.541151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f062ecb7-da04-4af4-a2ce-9d850480aab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:56.544112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 438/882] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Oct 3 12:25:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:56.552237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:56.564078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:56.629899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 445/883] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:56.646197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:56.665818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdf309-0203-4351-bf23-b513a39bb338 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:56.685642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062ecb7-da04-4af4-a2ce-9d850480aab9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:56.708637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:56.710156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.710919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.711390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.726593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:56.728740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:56.746232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:56.747241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:56.748140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:56.748140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:56.748140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:56.748140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 439/884] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:56.753484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:56.807265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062ecb7-da04-4af4-a2ce-9d850480aab9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:56.847040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:56.848466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.848965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.849486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.850389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:56.851933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:56.863099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:56.864142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:25:56.865023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:56.865853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 446/885] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:25:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:25:56.866549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:56.871783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868b82-58a0-4814-81c4-7ab986942721 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:56.885363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:56.910633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:56.916675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:56.917845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:56.918173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:56.918427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:56.919069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:56.919370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:56.920825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:56.932687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 440/886] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:25:56.934024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:56.979429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f2510-4bbf-4872-ba9a-91eb88e4dc81 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.013978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.014853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.015140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.015416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.016001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.017373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:57.026206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:57.027347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:57.028172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 447/887] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:25:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:57.028978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.039399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311f0ff-4069-4667-bec0-3a7bbbefbbb0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.076120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.076737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.077019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.077304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.077956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:57.078260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.079612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.084155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 441/888] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:25:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:57.084931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.114983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:57.138803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb544fc0-850c-4e21-ab2b-b80e7eb7f0fa None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.141931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:57.174329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd789-90a0-4e48-9768-9a73c0b8a1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.174936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd789-90a0-4e48-9768-9a73c0b8a1a4 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.175223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd789-90a0-4e48-9768-9a73c0b8a1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.175494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd789-90a0-4e48-9768-9a73c0b8a1a4 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.176141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dd789-90a0-4e48-9768-9a73c0b8a1a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.177539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dd789-90a0-4e48-9768-9a73c0b8a1a4 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.186747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd7d85-5ce1-4535-8ca5-f9bbc7a4bca1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.192941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 448/889] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:25:57 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:25:57.193806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd789-90a0-4e48-9768-9a73c0b8a1a4 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.235174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.235857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.236020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.236288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.245977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.247524 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:25:57.263284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:57.264539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:25:57.265533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 442/890] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:25:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:57.266875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.330514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd789-90a0-4e48-9768-9a73c0b8a1a4 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.370061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.371709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.372055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.372401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.373133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:57.373537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.375004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.381432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 449/891] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:25:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:57.382194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.385635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:57.391079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6900fc-dbdb-4805-9b5b-626b3cb84847 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.406972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:57.436071 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.436687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.437063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.437251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.438067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:57.438340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.439614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.445461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 443/892] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:25:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:57.449724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.500629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d799862-3f8f-4e38-babe-953a6309c9c2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.539845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.540708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.541176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.541695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.543473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:57.543988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.546467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.569897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 450/893] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Oct 3 12:25:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:57.570751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.576521 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc067979-2873-4f64-a33f-c69870b7860c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.617563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.618468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.618951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.619478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.620292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:57.620750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.622416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.627906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 444/894] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:25:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:57.629130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.644514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:57.707037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:57.711851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f922de-03af-42c9-82bd-e52868b30df1 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.752847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.753873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.754383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.754852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.755792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] RBAC: Adding query filter params (interface=public, service_id=406c97cde4f24702a092e558694b0937, region_id=RegionOne) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:57.756307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.757995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.765305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 451/895] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Oct 3 12:25:57 2022] GET /identity/v3/endpoints?service_id=406c97cde4f24702a092e558694b0937&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:57.771269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:57.779138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b3080-3975-40a0-9e95-e2a712afa711 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.819005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9915a-b015-48c1-955f-ef4f084ec611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.819641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9915a-b015-48c1-955f-ef4f084ec611 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.819937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9915a-b015-48c1-955f-ef4f084ec611 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.820212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9915a-b015-48c1-955f-ef4f084ec611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.911735 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9915a-b015-48c1-955f-ef4f084ec611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.913364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9915a-b015-48c1-955f-ef4f084ec611 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.919316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2144006-7251-46a0-8be0-3e7dcc3f8c86 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:57.946321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:57.958949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e9d18-17e8-4f73-b4a7-bd445b43c7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:57.960049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e9d18-17e8-4f73-b4a7-bd445b43c7bd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:57.960197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e9d18-17e8-4f73-b4a7-bd445b43c7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:57.960668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e9d18-17e8-4f73-b4a7-bd445b43c7bd None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:57.961473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e9d18-17e8-4f73-b4a7-bd445b43c7bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:57.962648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:57.963833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e9d18-17e8-4f73-b4a7-bd445b43c7bd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:57.977796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 452/896] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:25:57 2022] GET /identity/v3/services => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:25:58.039800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 445/897] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:25:57 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:25:58.045663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e9d18-17e8-4f73-b4a7-bd445b43c7bd None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:58.164530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e9d18-17e8-4f73-b4a7-bd445b43c7bd None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:58.201466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:58.202139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:58.202421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:58.202698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:58.214961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:58.216514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:25:58.231843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:58.232831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:25:58.233729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:25:58.233729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:25:58.233729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:58.233729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 453/898] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:58.239336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9915a-b015-48c1-955f-ef4f084ec611 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:58.345864 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9915a-b015-48c1-955f-ef4f084ec611 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:58.382421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:58.383041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:58.383326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:58.383595 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:58.384307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:58.384612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:58.386653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:58.395735 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:58.400028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 446/899] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:58.405589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:58.451660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:58.513473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b5283-0bfe-4b57-b21d-5c5479a09d4f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:58.549359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:58.550066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:58.550342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:58.550613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:58.560906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:58.562395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:25:58.575392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:25:58.576331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:25:58.577227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 454/900] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:25:58.584090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:58.701295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f783e6c-144d-4531-95c3-4cef1390d3ec None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:58.734181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bada5b-3706-4225-99ee-8751a9225261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:58.734826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bada5b-3706-4225-99ee-8751a9225261 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:58.735241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bada5b-3706-4225-99ee-8751a9225261 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:58.735516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bada5b-3706-4225-99ee-8751a9225261 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:58.736208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bada5b-3706-4225-99ee-8751a9225261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:58.736515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bada5b-3706-4225-99ee-8751a9225261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:58.738396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bada5b-3706-4225-99ee-8751a9225261 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:58.752518 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 447/901] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:58.758629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:58.868043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:58.873066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf18e3-3558-451b-8f03-d6adf7e46075 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:58.914504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f309c-643e-4663-ad39-a19263963aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:25:58.915121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f309c-643e-4663-ad39-a19263963aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:58.915401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f309c-643e-4663-ad39-a19263963aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:58.915671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f309c-643e-4663-ad39-a19263963aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:58.916399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f309c-643e-4663-ad39-a19263963aa0 None admin] RBAC: Adding query filter params (role.id=0cd23314a409488b99c3ed582dd894d9, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=df857935a0644938938b7fd8c33eabf3) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:25:58.916708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f309c-643e-4663-ad39-a19263963aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:25:58.918976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f309c-643e-4663-ad39-a19263963aa0 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:25:58.925367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 455/902] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:25:58 2022] GET /identity/v3/role_assignments?user.id=df857935a0644938938b7fd8c33eabf3&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=0cd23314a409488b99c3ed582dd894d9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:25:59.469123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aca12-af34-4c58-a1b3-3f43872ca446 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:59.469875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aca12-af34-4c58-a1b3-3f43872ca446 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:59.469875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163aca12-af34-4c58-a1b3-3f43872ca446 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:59.471301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 448/903] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:25:59.476966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf78789-0522-499a-99b4-5d0b1a647591 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:59.477265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf78789-0522-499a-99b4-5d0b1a647591 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:59.477576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf78789-0522-499a-99b4-5d0b1a647591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:59.496648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-aaf78789-0522-499a-99b4-5d0b1a647591 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:59.497889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-aaf78789-0522-499a-99b4-5d0b1a647591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:59.568775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 456/904] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:25:59.844082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aca12-af34-4c58-a1b3-3f43872ca446 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:25:59.856719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb5ec-59ce-4527-b333-2305dce746c0 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:59.857367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb5ec-59ce-4527-b333-2305dce746c0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:59.857880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb5ec-59ce-4527-b333-2305dce746c0 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:59.859675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 457/905] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:25:59.865597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403879f3-7940-4606-a6bb-6e9a9aad9eb7 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:25:59.866166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403879f3-7940-4606-a6bb-6e9a9aad9eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:25:59.866668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403879f3-7940-4606-a6bb-6e9a9aad9eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:25:59.889671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-403879f3-7940-4606-a6bb-6e9a9aad9eb7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:25:59.891209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-403879f3-7940-4606-a6bb-6e9a9aad9eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:25:59.913870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:25:59.977539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163aca12-af34-4c58-a1b3-3f43872ca446 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:25:59.978055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 458/906] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:25:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:00.006349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:00.006984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:00.007268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:00.007543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:00.008129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:00.009498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:00.019099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:00.020020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:26:00.020897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:00.025183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 449/907] 10.222.0.17 () {56 vars in 1132 bytes} [Mon Oct 3 12:25:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:00.026609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403879f3-7940-4606-a6bb-6e9a9aad9eb7 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:00.057168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:00.140382 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403879f3-7940-4606-a6bb-6e9a9aad9eb7 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:00.176557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:00.177177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:00.177459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:00.177766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:00.178403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:00.178715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:00.180091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:00.189871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 459/908] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:26:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:00.191462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:00.270384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:00.315907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2fb5a-9de3-4ffe-abb0-adda164e7b9e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:00.347520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:00.362246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c617b-23ff-4c27-b6ba-4c64cfd62fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:00.363129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c617b-23ff-4c27-b6ba-4c64cfd62fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:00.363415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c617b-23ff-4c27-b6ba-4c64cfd62fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:00.363869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c617b-23ff-4c27-b6ba-4c64cfd62fe3 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:00.365119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c617b-23ff-4c27-b6ba-4c64cfd62fe3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:00.365671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c617b-23ff-4c27-b6ba-4c64cfd62fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:00.367834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c617b-23ff-4c27-b6ba-4c64cfd62fe3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:00.375229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:00.376411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 450/909] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:26:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:00.377728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccd326-179f-41db-9521-95235018c77f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:00.378006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccd326-179f-41db-9521-95235018c77f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:00.378288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccd326-179f-41db-9521-95235018c77f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:00.379631 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 451/910] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:00.380346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccd326-179f-41db-9521-95235018c77f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:00.392513 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76083b18-7884-478a-ac91-569072f1fa4e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:00.426841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f89f3-bad1-453b-80fb-6f51ee383789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:00.427478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f89f3-bad1-453b-80fb-6f51ee383789 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:00.427775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f89f3-bad1-453b-80fb-6f51ee383789 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:00.428044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f89f3-bad1-453b-80fb-6f51ee383789 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:00.428718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f89f3-bad1-453b-80fb-6f51ee383789 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:00.430129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f89f3-bad1-453b-80fb-6f51ee383789 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:00.447634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 460/911] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:26:00 2022] POST /identity/v3/services => generated 241 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:26:00.449586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901bdd-798b-4763-b3d2-eb6f159729d9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:00.450374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901bdd-798b-4763-b3d2-eb6f159729d9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:00.450821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901bdd-798b-4763-b3d2-eb6f159729d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:00.481175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b6901bdd-798b-4763-b3d2-eb6f159729d9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:00.482903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b6901bdd-798b-4763-b3d2-eb6f159729d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:00.505740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccd326-179f-41db-9521-95235018c77f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:00.545776 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:00.546407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:00.546746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:00.547026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:00.547743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] RBAC: Adding query filter params (interface=public, service_id=61a4d7e60d3e420e85110e802c9a85c0, region_id=RegionOne) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:00.548062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:00.549458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:00.559121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 452/912] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Oct 3 12:26:00 2022] GET /identity/v3/endpoints?service_id=61a4d7e60d3e420e85110e802c9a85c0&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:00.565257 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:00.598484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 461/913] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:00.632612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:00.693871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0e57d-561f-4b71-83dd-b276c6f97cf4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:00.736109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462521a-44cf-492d-ac1d-40e0a066fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:00.736759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462521a-44cf-492d-ac1d-40e0a066fa85 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:00.737075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462521a-44cf-492d-ac1d-40e0a066fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:00.737353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462521a-44cf-492d-ac1d-40e0a066fa85 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:00.738263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462521a-44cf-492d-ac1d-40e0a066fa85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:00.739652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462521a-44cf-492d-ac1d-40e0a066fa85 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:00.746656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 453/914] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:26:00 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:26:00.874586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6901bdd-798b-4763-b3d2-eb6f159729d9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:00.961426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:00.996147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6901bdd-798b-4763-b3d2-eb6f159729d9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:01.041146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af6823-d46b-4598-be5c-6bbe3ba2454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:01.041906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af6823-d46b-4598-be5c-6bbe3ba2454e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:01.042193 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af6823-d46b-4598-be5c-6bbe3ba2454e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:01.042469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af6823-d46b-4598-be5c-6bbe3ba2454e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:01.043083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af6823-d46b-4598-be5c-6bbe3ba2454e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:01.044543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af6823-d46b-4598-be5c-6bbe3ba2454e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-a6af6823-d46b-4598-be5c-6bbe3ba2454e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:01.057805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:01.058854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 03 12:26:01.059697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:01.061685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 462/915] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:26:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:01.067421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462521a-44cf-492d-ac1d-40e0a066fa85 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:01.165454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ae267-979f-444b-97be-48b267b45db8 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:01.165770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ae267-979f-444b-97be-48b267b45db8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:01.166054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ae267-979f-444b-97be-48b267b45db8 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:01.167439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 463/916] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:01.173337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7297fd-025f-43d7-8df1-d3ee5c96497a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:01.173967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7297fd-025f-43d7-8df1-d3ee5c96497a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:01.174443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7297fd-025f-43d7-8df1-d3ee5c96497a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:01.195460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462521a-44cf-492d-ac1d-40e0a066fa85 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:01.211371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:01.223032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3f7297fd-025f-43d7-8df1-d3ee5c96497a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:01.224317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3f7297fd-025f-43d7-8df1-d3ee5c96497a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:01.248081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:01.249088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:01.249538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:01.249963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:01.250769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:01.253099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:01.254777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:01.266064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 454/917] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:26:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:01.273685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:01.405882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 464/918] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:01.414043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f3bbb-854f-4465-b9d6-89aef941d88e None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:01.472442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:01.473000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:01.473334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:01.473579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:01.474215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:01.474520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:01.476218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:01.485750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 455/919] 10.222.0.17 () {56 vars in 1114 bytes} [Mon Oct 3 12:26:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:01.488420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7297fd-025f-43d7-8df1-d3ee5c96497a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:01.638599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:01.671344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7297fd-025f-43d7-8df1-d3ee5c96497a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:01.710260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc52a0-0a2c-4596-8f30-daab8f39f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:01.711178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc52a0-0a2c-4596-8f30-daab8f39f0f9 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:01.711633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc52a0-0a2c-4596-8f30-daab8f39f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:01.712096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc52a0-0a2c-4596-8f30-daab8f39f0f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:01.712944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc52a0-0a2c-4596-8f30-daab8f39f0f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:01.714563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc52a0-0a2c-4596-8f30-daab8f39f0f9 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:01.727446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:01.741024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 465/920] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:26:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:26:01.782867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:01.852796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281104-a004-494f-84b7-3984153d85c4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:01.899969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00c04-6c6e-4704-a4b7-9a2baac8d7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:01.900626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00c04-6c6e-4704-a4b7-9a2baac8d7ad None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:01.900936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00c04-6c6e-4704-a4b7-9a2baac8d7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:01.901211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e00c04-6c6e-4704-a4b7-9a2baac8d7ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:01.913449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e00c04-6c6e-4704-a4b7-9a2baac8d7ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d5e00c04-6c6e-4704-a4b7-9a2baac8d7ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:01.919177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:01.920183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:01.921023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 456/921] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Oct 3 12:26:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:01.928180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc52a0-0a2c-4596-8f30-daab8f39f0f9 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:02.035286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc52a0-0a2c-4596-8f30-daab8f39f0f9 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:02.064869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:02.075739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:02.076386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:02.076626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:02.076902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:02.081566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:02.081566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:02.081566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:02.088954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 466/922] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Oct 3 12:26:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:02.094468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00c04-6c6e-4704-a4b7-9a2baac8d7ad None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:02.198532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:02.204866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e00c04-6c6e-4704-a4b7-9a2baac8d7ad None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:02.241354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:02.242036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:02.242402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:02.242827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:02.253783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:02.255282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:02.270651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:02.271658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:02.273165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:02.273165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:02.273165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:02.273165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 457/923] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:02.278363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:02.382280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d669e9-4d65-4660-a2d1-5ebae0fb0698 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:02.417396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:02.418031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:02.418316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:02.418643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:02.419383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:02.419690 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:02.421124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:02.437896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 467/924] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:02.439602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:02.546434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbed4-9dfb-4016-a29d-13c143393bcb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:02.584835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:02.585478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:02.585781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:02.586059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:02.594853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:02.596294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:26:02.608146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:02.609113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:26:02.610075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:02.613677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 458/925] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:26:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:02.615667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:02.672551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:02.742916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257da1d0-8c9a-4474-a8ea-983317d63df8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:02.782958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e569744-7700-456b-84e2-a78965894ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:02.783917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e569744-7700-456b-84e2-a78965894ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:02.784380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e569744-7700-456b-84e2-a78965894ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:02.784830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e569744-7700-456b-84e2-a78965894ef5 None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:02.785826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e569744-7700-456b-84e2-a78965894ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:02.786316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e569744-7700-456b-84e2-a78965894ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:02.787952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e569744-7700-456b-84e2-a78965894ef5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:02.807544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 468/926] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Oct 3 12:26:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:02.813457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:02.827772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:02.830345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e66f-a679-4d08-b4cf-df5ab9c6f11d None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:02.831170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e66f-a679-4d08-b4cf-df5ab9c6f11d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:02.832237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4e66f-a679-4d08-b4cf-df5ab9c6f11d None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:02.834850 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 469/927] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:02.841189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bc96-629c-44ee-a70a-14cbb4c2f63e None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:02.841479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bc96-629c-44ee-a70a-14cbb4c2f63e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:02.841805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bc96-629c-44ee-a70a-14cbb4c2f63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:02.861681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-c633bc96-629c-44ee-a70a-14cbb4c2f63e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:02.863539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c633bc96-629c-44ee-a70a-14cbb4c2f63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:02.952944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 470/928] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:02.957762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146d218-7768-44ee-8c7a-a7b6d30e21f0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.003037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea00d6-e5e8-406c-9e0e-18877d90aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.003675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea00d6-e5e8-406c-9e0e-18877d90aff3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.003953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea00d6-e5e8-406c-9e0e-18877d90aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.004228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea00d6-e5e8-406c-9e0e-18877d90aff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.015955 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea00d6-e5e8-406c-9e0e-18877d90aff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.017460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea00d6-e5e8-406c-9e0e-18877d90aff3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-40ea00d6-e5e8-406c-9e0e-18877d90aff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:03.032424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:03.033374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:03.034305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:03.034305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:03.034305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:03.034305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 459/929] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:03.042921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633bc96-629c-44ee-a70a-14cbb4c2f63e None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.083881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722511-bfcf-49c2-ab14-057c84c35684 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.084217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722511-bfcf-49c2-ab14-057c84c35684 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.084461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722511-bfcf-49c2-ab14-057c84c35684 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.086082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 460/930] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:26:03.088084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:03.095380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a2d7-aaaa-4f80-a978-34dde5c2de3b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.096008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a2d7-aaaa-4f80-a978-34dde5c2de3b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.096485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30a2d7-aaaa-4f80-a978-34dde5c2de3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.120180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3e30a2d7-aaaa-4f80-a978-34dde5c2de3b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:03.121871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3e30a2d7-aaaa-4f80-a978-34dde5c2de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:03.155999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633bc96-629c-44ee-a70a-14cbb4c2f63e None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.189500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:03.203806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.204177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 461/931] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:03.204817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.205313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.205779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.206568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:03.207002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.208512 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.221191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 471/932] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:03.226985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30a2d7-aaaa-4f80-a978-34dde5c2de3b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.239502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.342553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30a2d7-aaaa-4f80-a978-34dde5c2de3b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.366912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:03.371922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896992-dc23-4a53-84f2-61deee6cc854 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.387321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.388058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.388410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.388750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.396382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.398162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.408642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.409484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.409933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.410389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.411169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:26:03.411381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:03.412212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:03.413184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:26:03.413184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:26:03.413184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:26:03.413184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:26:03.413184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:26:03.413184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:26:03.413184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:03.413184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:03.415551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.417873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 462/933] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:03.419392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:03.426141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:03.427134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:03.427966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:03.430828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 472/934] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:03.438462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.489002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:03.542219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7bc5-a0a5-48db-8ccd-9e42385a9bea None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.547653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b213c-47fc-4812-813a-314348bcc11d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.580029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.580809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.581183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.581544 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.582326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:03.582706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.583533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.584137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.584289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.584422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.584679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.585305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:03.585632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.586988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.597323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 473/935] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:03.598142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.598506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 463/936] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:03.599246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.636080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:03.715331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215663e-a12b-4c40-8de3-f0dd5995919f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.720940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b440ae6-9134-430d-9181-0d743cda4320 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.728280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:03.756145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.756797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.757137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.757417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.758080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:03.758384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.759739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.763839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.764775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.770072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 464/937] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:03.770225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.770225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.770391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.770462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.770462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:03.783050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:03.784052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:03.784941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 474/938] 10.222.0.17 () {56 vars in 1132 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:03.786267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.900023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:03.912206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78d8c-6c31-4080-9451-cd776ddfe4a2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.912983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec646b6-736d-4d69-9c36-00dcb80e1bdb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:03.952346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.952926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dac4a-436e-4e6e-9c4b-1ed74c20f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:03.953046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.953279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.953593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.953730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dac4a-436e-4e6e-9c4b-1ed74c20f684 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:03.953973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dac4a-436e-4e6e-9c4b-1ed74c20f684 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:03.954263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1dac4a-436e-4e6e-9c4b-1ed74c20f684 None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/df857935a0644938938b7fd8c33eabf3/roles/0cd23314a409488b99c3ed582dd894d9` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:03.954361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] RBAC: Adding query filter params (interface=public, service_id=ede1e349955740339c609c345a3eff31, region_id=RegionOne) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:03.954614 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.956002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.956466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dac4a-436e-4e6e-9c4b-1ed74c20f684 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=df857935a0644938938b7fd8c33eabf3, role_id=0cd23314a409488b99c3ed582dd894d9)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:03.957923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1dac4a-436e-4e6e-9c4b-1ed74c20f684 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:03.962110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 475/939] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/endpoints?service_id=ede1e349955740339c609c345a3eff31&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:03.962826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:03.989545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 465/940] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:26:03 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/df857935a0644938938b7fd8c33eabf3/roles/0cd23314a409488b99c3ed582dd894d9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:26:03.989545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dac4a-436e-4e6e-9c4b-1ed74c20f684 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:04.054024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:04.094545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddd858-119f-4281-b072-d1af77f9887b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:04.139340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1dac4a-436e-4e6e-9c4b-1ed74c20f684 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:04.141051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:04.141835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:04.142224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:04.142592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:04.143315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:04.143696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:04.145178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:04.151954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 476/941] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:04.157946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:04.183877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf25b74-cfac-4285-81e5-3c456f4f48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:04.184516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf25b74-cfac-4285-81e5-3c456f4f48a4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:04.184803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf25b74-cfac-4285-81e5-3c456f4f48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:04.185085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf25b74-cfac-4285-81e5-3c456f4f48a4 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:04.185730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf25b74-cfac-4285-81e5-3c456f4f48a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:04.187184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf25b74-cfac-4285-81e5-3c456f4f48a4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:04.189158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:04.195006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 466/942] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:26:03 2022] GET /identity/v3/services => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:26:04.197068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bae168-3ec2-4be1-9522-57c7041bcf87 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:04.197356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bae168-3ec2-4be1-9522-57c7041bcf87 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:04.198324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bae168-3ec2-4be1-9522-57c7041bcf87 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:04.201675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 467/943] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:04.207387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54a722-137c-4ecc-a1f6-909337d504e2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:04.207731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54a722-137c-4ecc-a1f6-909337d504e2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:04.208014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54a722-137c-4ecc-a1f6-909337d504e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:04.235685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-bf54a722-137c-4ecc-a1f6-909337d504e2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:04.237641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bf54a722-137c-4ecc-a1f6-909337d504e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:04.299062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb91fe44-ebed-435e-b32c-c8f07efe0800 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:04.314318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 468/944] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:04.340668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:04.341313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:04.341625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:04.341903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:04.342551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:04.342862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:04.344369 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:04.350635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 477/945] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:26:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:04.356498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54a722-137c-4ecc-a1f6-909337d504e2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:04.388620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:04.466773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54a722-137c-4ecc-a1f6-909337d504e2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:04.502563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8f810-63bc-49ea-a701-4e5ccde05268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:04.503183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8f810-63bc-49ea-a701-4e5ccde05268 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:04.503461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8f810-63bc-49ea-a701-4e5ccde05268 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:04.503736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8f810-63bc-49ea-a701-4e5ccde05268 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:04.504422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8f810-63bc-49ea-a701-4e5ccde05268 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:04.505922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8f810-63bc-49ea-a701-4e5ccde05268 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:04.530912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 469/946] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:26:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:26:04.599723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:04.701611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:04.727535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd152aa-3c5b-44de-8697-a65b64ae53e6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:04.771012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:04.771932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:04.772386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:04.772804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:04.773625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:04.775248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:04.778359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING keystone.server.flask.common [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 03 12:26:04.798803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.sql.core [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 12:26:04.798803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 03 12:26:04.798803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [parameters: {'id': '186975c04ad1459aaf98b7cc94f396d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 03 12:26:04.798803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81413) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 186975c04ad1459aaf98b7cc94f396d3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 186975c04ad1459aaf98b7cc94f396d3. Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application conn.query(q) Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 12:26:04.816921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result.read() Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 03 12:26:04.818044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application next(self.gen) Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application yield resource Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application next(self.gen) Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise self.value Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application session.commit() Oct 03 12:26:04.819278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.session.flush() Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application compat.raise_( Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 12:26:04.820317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 12:26:04.821315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application conn.query(q) Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result.read() Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 12:26:04.822223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [parameters: {'id': '186975c04ad1459aaf98b7cc94f396d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:04.823182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:04.824150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 186975c04ad1459aaf98b7cc94f396d3. Oct 03 12:26:04.825255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:04.827668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 478/947] 10.222.0.17 () {60 vars in 1140 bytes} [Mon Oct 3 12:26:04 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:04.833392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8f810-63bc-49ea-a701-4e5ccde05268 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:04.952857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:04.973798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8f810-63bc-49ea-a701-4e5ccde05268 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:05.011674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185db6c-e3e7-418c-bc6c-d80ee7ee18ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:05.012628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185db6c-e3e7-418c-bc6c-d80ee7ee18ff None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:05.013123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185db6c-e3e7-418c-bc6c-d80ee7ee18ff None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:05.013606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185db6c-e3e7-418c-bc6c-d80ee7ee18ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:05.021085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185db6c-e3e7-418c-bc6c-d80ee7ee18ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:05.022800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185db6c-e3e7-418c-bc6c-d80ee7ee18ff None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9185db6c-e3e7-418c-bc6c-d80ee7ee18ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:26:05.034947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:05.035895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:05.036793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:26:05.036793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:26:05.036793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:26:05.036793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:26:05.036793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:26:05.036793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:26:05.036793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:05.036793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:05.039005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 470/948] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:05.046857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:05.157706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a7de-e2a2-4838-9655-aae7da4dc49a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:05.197176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2efb5-f6e7-431a-917c-a9e79cb81221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:05.197867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2efb5-f6e7-431a-917c-a9e79cb81221 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:05.198150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2efb5-f6e7-431a-917c-a9e79cb81221 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:05.198426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2efb5-f6e7-431a-917c-a9e79cb81221 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:05.199099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2efb5-f6e7-431a-917c-a9e79cb81221 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:05.199429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2efb5-f6e7-431a-917c-a9e79cb81221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:05.201196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2efb5-f6e7-431a-917c-a9e79cb81221 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:05.203086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:05.224536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 479/949] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:26:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:06.257460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c116d30-c0a4-4551-a120-0b923749d84a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:06.258183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c116d30-c0a4-4551-a120-0b923749d84a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:06.258183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c116d30-c0a4-4551-a120-0b923749d84a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:06.259611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 471/950] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:06.265167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e997fd3-4e3b-4283-9a8f-29e351bb7657 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:06.265695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e997fd3-4e3b-4283-9a8f-29e351bb7657 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:06.265898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e997fd3-4e3b-4283-9a8f-29e351bb7657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:06.284744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1e997fd3-4e3b-4283-9a8f-29e351bb7657 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:06.286298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1e997fd3-4e3b-4283-9a8f-29e351bb7657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:06.359077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 480/951] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:06.520472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaf381-5f6b-454a-b22a-538f8ef63305 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:06.521080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaf381-5f6b-454a-b22a-538f8ef63305 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:06.521602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaf381-5f6b-454a-b22a-538f8ef63305 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:06.523389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 472/952] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:06.529287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536edb-ae79-4e9d-a377-15bbd302cc4e None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:06.529917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536edb-ae79-4e9d-a377-15bbd302cc4e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:06.530386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77536edb-ae79-4e9d-a377-15bbd302cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:06.560962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-77536edb-ae79-4e9d-a377-15bbd302cc4e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:06.563668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-77536edb-ae79-4e9d-a377-15bbd302cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:06.630814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceaf381-5f6b-454a-b22a-538f8ef63305 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:06.644152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 481/953] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:06.743813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceaf381-5f6b-454a-b22a-538f8ef63305 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:06.780454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ae82-b8fc-4d35-9d8c-ff48864d88c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:06.781018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ae82-b8fc-4d35-9d8c-ff48864d88c5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:06.781336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ae82-b8fc-4d35-9d8c-ff48864d88c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:06.781600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ae82-b8fc-4d35-9d8c-ff48864d88c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:06.792560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629ae82-b8fc-4d35-9d8c-ff48864d88c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b629ae82-b8fc-4d35-9d8c-ff48864d88c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:06.797818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:06.798877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:06.800085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 473/954] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Oct 3 12:26:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:06.805103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77536edb-ae79-4e9d-a377-15bbd302cc4e None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:06.867507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:06.916487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77536edb-ae79-4e9d-a377-15bbd302cc4e None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:06.946024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ae82-b8fc-4d35-9d8c-ff48864d88c5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:06.954349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:06.959366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0d4f9-2c15-4d4a-905d-7c0d0cf84a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:06.960004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0d4f9-2c15-4d4a-905d-7c0d0cf84a33 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:06.960313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0d4f9-2c15-4d4a-905d-7c0d0cf84a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:06.960603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0d4f9-2c15-4d4a-905d-7c0d0cf84a33 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:06.961296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0d4f9-2c15-4d4a-905d-7c0d0cf84a33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:06.961636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0d4f9-2c15-4d4a-905d-7c0d0cf84a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:06.963044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0d4f9-2c15-4d4a-905d-7c0d0cf84a33 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:06.972718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 482/955] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Oct 3 12:26:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:06.974015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fed5-6d8a-4d25-9b3b-6346ce316db8 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:06.974301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fed5-6d8a-4d25-9b3b-6346ce316db8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:06.974581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fed5-6d8a-4d25-9b3b-6346ce316db8 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:06.975999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 483/956] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:06.981173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6fed5-6d8a-4d25-9b3b-6346ce316db8 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.067338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ae82-b8fc-4d35-9d8c-ff48864d88c5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.091784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6fed5-6d8a-4d25-9b3b-6346ce316db8 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.103337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298f9e3-4378-4fcb-bf2d-035398ce1a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.104762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f9e3-4378-4fcb-bf2d-035398ce1a03 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.105229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f9e3-4378-4fcb-bf2d-035398ce1a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.105752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f9e3-4378-4fcb-bf2d-035398ce1a03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.106412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298f9e3-4378-4fcb-bf2d-035398ce1a03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.107787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298f9e3-4378-4fcb-bf2d-035398ce1a03 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.109344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-9298f9e3-4378-4fcb-bf2d-035398ce1a03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:07.118391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:07.120086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:07.120951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 474/957] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:26:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:07.122359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14855488-ebf5-4ae1-b940-a4cd2486cf54 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.122359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14855488-ebf5-4ae1-b940-a4cd2486cf54 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.122359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14855488-ebf5-4ae1-b940-a4cd2486cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.135511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.136240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.136523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.136795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.140323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-14855488-ebf5-4ae1-b940-a4cd2486cf54 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:07.141541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-14855488-ebf5-4ae1-b940-a4cd2486cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:07.147452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.148928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:07.165299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:07.166876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:07.167795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:07.167795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:07.167795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:07.167795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 484/958] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:07.167795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.212317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:07.219238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 475/959] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:07.220340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14855488-ebf5-4ae1-b940-a4cd2486cf54 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.302837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af5792-78b3-486d-a72a-e2ece10fb8f8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.331012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14855488-ebf5-4ae1-b940-a4cd2486cf54 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.349821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.350470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.351126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.351415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.352054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:07.352363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.354387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.361694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 485/960] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:26:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:07.367029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.373132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.374123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.374694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.375192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.376065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:07.376588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.378402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.393865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 476/961] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:07.399822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.420942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:07.480897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:07.506848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49bcf-c2a3-4b5b-bedc-77ddcbbfa412 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.532321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870dbe67-c9bc-41c5-b96a-76c9f21efc4f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.542866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48dc3bc-fa59-4ae5-b24b-d8f3e17d4a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.543480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc3bc-fa59-4ae5-b24b-d8f3e17d4a92 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.543764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc3bc-fa59-4ae5-b24b-d8f3e17d4a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.544041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48dc3bc-fa59-4ae5-b24b-d8f3e17d4a92 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.544678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dc3bc-fa59-4ae5-b24b-d8f3e17d4a92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:07.544983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dc3bc-fa59-4ae5-b24b-d8f3e17d4a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.546417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48dc3bc-fa59-4ae5-b24b-d8f3e17d4a92 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.556116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 486/962] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:26:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:07.556116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592a95a-cbff-49db-92cd-35e41f99b677 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.556116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592a95a-cbff-49db-92cd-35e41f99b677 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.556116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592a95a-cbff-49db-92cd-35e41f99b677 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.556116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 487/963] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:07.556116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592a95a-cbff-49db-92cd-35e41f99b677 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.572018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.572684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.572975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.573253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.580745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.582275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:26:07.595687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:07.596692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 477/964] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:26:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:07.597683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.654341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:07.661667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592a95a-cbff-49db-92cd-35e41f99b677 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.700622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb311373-d2b0-4bf6-9b59-58b8ced8fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.701265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb311373-d2b0-4bf6-9b59-58b8ced8fe72 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.701578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb311373-d2b0-4bf6-9b59-58b8ced8fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.701858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb311373-d2b0-4bf6-9b59-58b8ced8fe72 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.702452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb311373-d2b0-4bf6-9b59-58b8ced8fe72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.703829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb311373-d2b0-4bf6-9b59-58b8ced8fe72 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.704178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69ade-a52b-4bf1-a21a-96272234da8a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-bb311373-d2b0-4bf6-9b59-58b8ced8fe72 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:07.712872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:07.714695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:07.715673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 488/965] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:07.716520 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f455e-2c2c-414f-a8c4-2bc3b427740c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.716520 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f455e-2c2c-414f-a8c4-2bc3b427740c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.716520 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f455e-2c2c-414f-a8c4-2bc3b427740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.725281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:07.734570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1c9f455e-2c2c-414f-a8c4-2bc3b427740c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:07.735917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1c9f455e-2c2c-414f-a8c4-2bc3b427740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:07.742997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec5a98-cdb9-4702-9fb0-8a98951e1512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.743616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5a98-cdb9-4702-9fb0-8a98951e1512 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.743895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5a98-cdb9-4702-9fb0-8a98951e1512 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.744201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5a98-cdb9-4702-9fb0-8a98951e1512 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.744872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec5a98-cdb9-4702-9fb0-8a98951e1512 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.746265 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec5a98-cdb9-4702-9fb0-8a98951e1512 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.770485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 478/966] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:26:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:26:07.771777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec5a98-cdb9-4702-9fb0-8a98951e1512 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.832432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 489/967] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:07.833820 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f455e-2c2c-414f-a8c4-2bc3b427740c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:07.921887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec5a98-cdb9-4702-9fb0-8a98951e1512 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.953583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:07.969937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:07.970907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:07.971396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:07.971810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:07.972681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:07.973122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:07.974515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f455e-2c2c-414f-a8c4-2bc3b427740c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:07.974928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:07.997048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 479/968] 10.222.0.17 () {56 vars in 1149 bytes} [Mon Oct 3 12:26:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:08.003463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:08.016407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:08.017148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:08.017431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:08.017742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:08.018375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:08.018683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:08.020272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:08.029245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 490/969] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:26:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:08.034584 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:08.041063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:08.130183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241acfb-ace6-468b-9097-808e0c3dcde9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:08.152159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffeaad0-dd9a-4ca3-80f7-c5f409044b82 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:08.174519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ce957-70b4-472f-987b-60694a48bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:08.175147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce957-70b4-472f-987b-60694a48bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:08.175642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce957-70b4-472f-987b-60694a48bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:08.175854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce957-70b4-472f-987b-60694a48bfd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:08.189144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:08.189861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:08.190146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:08.190428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:08.191067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:08.191376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:08.192767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:08.201650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 491/970] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:26:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:08.201650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:08.240572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:08.276938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ce957-70b4-472f-987b-60694a48bfd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:08.278394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ce957-70b4-472f-987b-60694a48bfd0 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:08.313481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:08.343502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f921a-8b2f-403e-90d7-c7a3b0fbcc04 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:08.386214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:08.387317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:08.387757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:08.388206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:08.389017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:08.391027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:08.394516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 480/971] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 12:26:08.402703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ce957-70b4-472f-987b-60694a48bfd0 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:08.409288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.sql.core [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 12:26:08.409288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 03 12:26:08.409288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [parameters: {'user_id': '2daaa4b7b8524a59b7a1d989401fe18c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 03 12:26:08.409288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81413) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application conn.query(q) Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result.read() Oct 03 12:26:08.421054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 12:26:08.422247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application next(self.gen) Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application yield resource Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application next(self.gen) Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.session.rollback() Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.force_reraise() Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise self.value Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application session.commit() Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 03 12:26:08.423442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._prepare_impl() Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.session.flush() Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._flush(objects) Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application compat.raise_( Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application flush_context.execute() Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rec.execute(self) Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 03 12:26:08.424571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 03 12:26:08.425788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result = self._query(query) Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application conn.query(q) Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application result.read() Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 03 12:26:08.426861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [parameters: {'user_id': '2daaa4b7b8524a59b7a1d989401fe18c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:08.427970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 03 12:26:08.429000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 03 12:26:08.430180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 03 12:26:08.430180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 03 12:26:08.430180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 03 12:26:08.430180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 03 12:26:08.430180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 03 12:26:08.430180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:08.432366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 492/972] 10.222.0.17 () {60 vars in 1131 bytes} [Mon Oct 3 12:26:08 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:08.440351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:08.540300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:08.541749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ce957-70b4-472f-987b-60694a48bfd0 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:08.569120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10911-68ca-4e6c-8fa3-448e77d8d01f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:08.582935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:08.584103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:08.584576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:08.585448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:08.593137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:08.599095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:08.600753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:08.607643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:08.608374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:08.608729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:08.609077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:08.617467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:08.619837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:08.621289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:08.622484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:08.623650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:08.623650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:08.623650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:08.626105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 481/973] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:08.631809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:26:08.640358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:08.641557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 03 12:26:08.642863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:08.650387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 493/974] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:26:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:08.651485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:08.775921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e132594-13ff-4f7c-b665-de25f438cccb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:08.804004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373a1f0-3085-4b50-a2b7-9c872af09ede None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:08.819246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:08.820091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:08.820467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:08.820844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:08.821597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:08.822005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:08.823766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:08.844241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 482/975] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:08.846355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:08.851589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:08.852464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:08.852928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:08.853445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:08.854837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:08.855347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:08.857552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:08.872854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:08.902416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:08.913600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 494/976] 10.222.0.17 () {56 vars in 1101 bytes} [Mon Oct 3 12:26:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:08.986726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a358bf2-4334-49a2-9a2a-bd650286edd9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:09.028132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:09.028800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:09.029083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:09.029362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:09.037195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:09.038859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:26:09.051819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:09.052811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:09.054025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 483/977] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:09.061555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:09.177815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5462ee6-aa16-4934-859a-26c6d5bc0f2b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:09.216961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0aa45-6e8e-43d7-a751-4a3af4341136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:09.217600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0aa45-6e8e-43d7-a751-4a3af4341136 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:09.217889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0aa45-6e8e-43d7-a751-4a3af4341136 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:09.218161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0aa45-6e8e-43d7-a751-4a3af4341136 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:09.218860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0aa45-6e8e-43d7-a751-4a3af4341136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:09.219171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0aa45-6e8e-43d7-a751-4a3af4341136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:09.220605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0aa45-6e8e-43d7-a751-4a3af4341136 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:09.233943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 495/978] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:09.240361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:09.348375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e8412-b91b-435e-bfc8-3733449319f6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:09.351493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:09.384632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda7246-f60d-4200-a3fc-688647074fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:09.385237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda7246-f60d-4200-a3fc-688647074fbd None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:09.385535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda7246-f60d-4200-a3fc-688647074fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:09.385825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda7246-f60d-4200-a3fc-688647074fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:09.386547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda7246-f60d-4200-a3fc-688647074fbd None admin] RBAC: Adding query filter params (role.id=0cd23314a409488b99c3ed582dd894d9, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=df857935a0644938938b7fd8c33eabf3) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:09.386861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda7246-f60d-4200-a3fc-688647074fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:09.388283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda7246-f60d-4200-a3fc-688647074fbd None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:09.394378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 484/979] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:26:09 2022] GET /identity/v3/role_assignments?user.id=df857935a0644938938b7fd8c33eabf3&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=0cd23314a409488b99c3ed582dd894d9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:10.061833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d75a80-e709-4bb7-aa63-f3c2f92a2f3b None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:10.062335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d75a80-e709-4bb7-aa63-f3c2f92a2f3b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:10.062335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d75a80-e709-4bb7-aa63-f3c2f92a2f3b None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:10.063786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 496/980] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:10.068819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26ae8a-71c3-42e8-a5c5-ed1ce74e8af3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:10.069220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26ae8a-71c3-42e8-a5c5-ed1ce74e8af3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:10.069384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26ae8a-71c3-42e8-a5c5-ed1ce74e8af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:10.088921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5f26ae8a-71c3-42e8-a5c5-ed1ce74e8af3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:10.090138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5f26ae8a-71c3-42e8-a5c5-ed1ce74e8af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:10.159859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 485/981] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:10.435994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d75a80-e709-4bb7-aa63-f3c2f92a2f3b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:10.466589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295b642-695f-4629-8026-76db33fe2479 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:10.466929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295b642-695f-4629-8026-76db33fe2479 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:10.467158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295b642-695f-4629-8026-76db33fe2479 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:10.468508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 486/982] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:26:10.473468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205279-7bbb-47f9-b0e5-7c5eda4e07cf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:10.473793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205279-7bbb-47f9-b0e5-7c5eda4e07cf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:10.474076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205279-7bbb-47f9-b0e5-7c5eda4e07cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:10.493325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-25205279-7bbb-47f9-b0e5-7c5eda4e07cf None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:10.494426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:10.495077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-25205279-7bbb-47f9-b0e5-7c5eda4e07cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:10.544669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d75a80-e709-4bb7-aa63-f3c2f92a2f3b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:10.570379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 487/983] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:10.579621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90478a64-509b-4213-a238-de097699024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:10.580249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90478a64-509b-4213-a238-de097699024f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:10.580525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90478a64-509b-4213-a238-de097699024f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:10.580797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90478a64-509b-4213-a238-de097699024f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:10.581378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90478a64-509b-4213-a238-de097699024f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:10.582779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90478a64-509b-4213-a238-de097699024f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-90478a64-509b-4213-a238-de097699024f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:10.591459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:10.592438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:10.593277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:10.594906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 497/984] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:26:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:10.598355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25205279-7bbb-47f9-b0e5-7c5eda4e07cf None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:10.626524 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:10.700941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25205279-7bbb-47f9-b0e5-7c5eda4e07cf None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:10.735375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:10.735988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:10.736273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:10.736545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:10.737418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:10.737753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:10.739163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:10.744770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 488/985] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:26:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:10.750536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90478a64-509b-4213-a238-de097699024f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:10.835056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:10.855070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90478a64-509b-4213-a238-de097699024f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:10.876802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:10.894378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:10.894997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:10.895278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:10.895554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:10.896188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:10.896507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:10.897911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:10.903106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 498/986] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:26:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:10.908792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:10.942871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:10.953820 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da36a2-51c4-4014-ac99-b60acac35be5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:10.999456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ff382-b1ac-4128-bb24-aaa9a98c3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:11.000072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ff382-b1ac-4128-bb24-aaa9a98c3a8b None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:11.000349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ff382-b1ac-4128-bb24-aaa9a98c3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:11.000621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ff382-b1ac-4128-bb24-aaa9a98c3a8b None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:11.001266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ff382-b1ac-4128-bb24-aaa9a98c3a8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:11.002654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ff382-b1ac-4128-bb24-aaa9a98c3a8b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:11.015991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103de28e-adbd-46ce-a186-8b3ac59cac2e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:11.029555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 489/987] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:26:10 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:26:11.064461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c3220-7a30-448c-8899-724b87ea82da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:11.065187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3220-7a30-448c-8899-724b87ea82da None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:11.065420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3220-7a30-448c-8899-724b87ea82da None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:11.065724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3220-7a30-448c-8899-724b87ea82da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:11.066449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c3220-7a30-448c-8899-724b87ea82da None admin] RBAC: Adding query filter params (interface=admin, service_id=ede1e349955740339c609c345a3eff31, region_id=RegionOne) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:11.066773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c3220-7a30-448c-8899-724b87ea82da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:11.068162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c3220-7a30-448c-8899-724b87ea82da None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:11.074571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 499/988] 10.222.0.17 () {56 vars in 1249 bytes} [Mon Oct 3 12:26:10 2022] GET /identity/v3/endpoints?service_id=ede1e349955740339c609c345a3eff31&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:11.080330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ff382-b1ac-4128-bb24-aaa9a98c3a8b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:11.195797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ff382-b1ac-4128-bb24-aaa9a98c3a8b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:11.236496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deca98-2589-4209-b78c-16db2f310b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:11.237371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deca98-2589-4209-b78c-16db2f310b34 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:11.237732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deca98-2589-4209-b78c-16db2f310b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:11.238013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deca98-2589-4209-b78c-16db2f310b34 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:11.238620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deca98-2589-4209-b78c-16db2f310b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:11.239992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deca98-2589-4209-b78c-16db2f310b34 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:11.246870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 490/989] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:26:11 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:26:11.590170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c86d2-43ba-42ca-a939-87660743d202 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:11.590379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c86d2-43ba-42ca-a939-87660743d202 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:11.590660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c86d2-43ba-42ca-a939-87660743d202 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:11.592016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 500/990] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:11.597343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb8e4-99b8-4437-a880-3a173fcfd06c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:11.597672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb8e4-99b8-4437-a880-3a173fcfd06c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:11.597954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb8e4-99b8-4437-a880-3a173fcfd06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:11.616714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-be9fb8e4-99b8-4437-a880-3a173fcfd06c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:11.617950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-be9fb8e4-99b8-4437-a880-3a173fcfd06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:11.629855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:11.695664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 491/991] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:11.960218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c86d2-43ba-42ca-a939-87660743d202 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:12.007919 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:12.068326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c86d2-43ba-42ca-a939-87660743d202 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:12.102019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:12.102648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:12.102931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:12.103261 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] PATH_INFO: `/v3/services/image` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:12.103845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:12.105214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:12.114199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:12.115230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:12.116098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:12.120856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 501/992] 10.222.0.17 () {56 vars in 1105 bytes} [Mon Oct 3 12:26:11 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:12.122203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb8e4-99b8-4437-a880-3a173fcfd06c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:12.230464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb8e4-99b8-4437-a880-3a173fcfd06c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:12.266650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a55cb4-eca7-4979-9027-b76a2fdc4590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:12.267311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55cb4-eca7-4979-9027-b76a2fdc4590 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:12.267594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55cb4-eca7-4979-9027-b76a2fdc4590 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:12.267869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55cb4-eca7-4979-9027-b76a2fdc4590 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:12.268690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a55cb4-eca7-4979-9027-b76a2fdc4590 None admin] RBAC: Adding query filter params (name=image) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:12.269005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a55cb4-eca7-4979-9027-b76a2fdc4590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:12.270412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a55cb4-eca7-4979-9027-b76a2fdc4590 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:12.281242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 492/993] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:12.282846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:12.393708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e1a91-c3e5-492e-a3c5-18daa6837d1e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:12.402077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:12.432880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1fb5b-b390-446b-bcf1-4cf5e7648c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:12.433498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1fb5b-b390-446b-bcf1-4cf5e7648c9c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:12.433809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1fb5b-b390-446b-bcf1-4cf5e7648c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:12.434083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1fb5b-b390-446b-bcf1-4cf5e7648c9c None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:12.434726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1fb5b-b390-446b-bcf1-4cf5e7648c9c None admin] RBAC: Adding query filter params (type=image) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:12.435030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1fb5b-b390-446b-bcf1-4cf5e7648c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:12.436410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1fb5b-b390-446b-bcf1-4cf5e7648c9c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:12.441721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 502/994] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:13.210018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59694f-ee18-4131-bcaf-35761a6277f2 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:13.210557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59694f-ee18-4131-bcaf-35761a6277f2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:13.210557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59694f-ee18-4131-bcaf-35761a6277f2 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:13.212045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 493/995] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:13.217688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96591fe9-5bb6-43e7-880f-bf1c73c0c8a6 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:13.218090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96591fe9-5bb6-43e7-880f-bf1c73c0c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:13.218269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96591fe9-5bb6-43e7-880f-bf1c73c0c8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:13.236917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-96591fe9-5bb6-43e7-880f-bf1c73c0c8a6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:13.238453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-96591fe9-5bb6-43e7-880f-bf1c73c0c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:13.307806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 503/996] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:13.417382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17fdc-188c-4ebf-88ff-9dc7ab7fb8c8 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:13.417796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17fdc-188c-4ebf-88ff-9dc7ab7fb8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:13.417977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17fdc-188c-4ebf-88ff-9dc7ab7fb8c8 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:13.419449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 494/997] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:13.424476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee154c9-ea35-450d-b101-f3b58bb3075a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:13.424760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee154c9-ea35-450d-b101-f3b58bb3075a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:13.425033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee154c9-ea35-450d-b101-f3b58bb3075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:13.443657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-aee154c9-ea35-450d-b101-f3b58bb3075a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:13.444833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-aee154c9-ea35-450d-b101-f3b58bb3075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:13.514351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 504/998] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:13.572628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17fdc-188c-4ebf-88ff-9dc7ab7fb8c8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:13.585623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:13.685091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17fdc-188c-4ebf-88ff-9dc7ab7fb8c8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:13.729939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:13.730581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:13.730861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:13.731136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:13.731720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:13.733083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:13.742536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:13.744173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:13.745742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 495/999] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:13.750090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee154c9-ea35-450d-b101-f3b58bb3075a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:13.780872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:13.791346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:13.867645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee154c9-ea35-450d-b101-f3b58bb3075a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:13.884569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:13.907081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:13.907695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:13.907989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:13.908294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:13.908880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:13.909183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:13.910612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:13.912585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3fb66-6f1f-4c33-9f20-044c98584438 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:13.915861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 505/1000] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:26:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:13.921592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:13.949578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:13.950226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:13.950499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:13.950771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:13.951349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:13.952712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:13.961996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:13.963016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:13.967072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 496/1001] 10.222.0.17 () {56 vars in 1126 bytes} [Mon Oct 3 12:26:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:13.969463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:14.032814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:14.041654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b807b5-eb44-4ecf-be3f-a8bc3c8f8a41 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:14.076564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:14.077210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:14.077497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:14.077802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:14.078435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:14.078746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:14.079328 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191243c-127a-4434-9493-3f56c514d1f9 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:14.080123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:14.085451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 506/1002] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:26:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:14.091582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:14.118601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:14.119521 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:14.119962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:14.120227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:14.120861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:14.121164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:14.123051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:14.128156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 497/1003] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:26:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:14.133564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:14.136649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:14.203264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96fd7a-0dc1-4494-9eae-4b693732a0dc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:14.243267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:14.244012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:14.244197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:14.244474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:14.245174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] RBAC: Adding query filter params (interface=public, service_id=c207fca49db34e66bd4aa8caf0ebe002, region_id=RegionOne) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:14.245490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:14.246887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:14.248513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb232c-d485-41c1-a827-181404b83120 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:14.252400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 507/1004] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Oct 3 12:26:14 2022] GET /identity/v3/endpoints?service_id=c207fca49db34e66bd4aa8caf0ebe002&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:14.257852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:14.285299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:14.288940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:14.289949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:14.291069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:14.291408 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:14.292207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:14.292523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:14.294549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:14.300981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 498/1005] 10.222.0.17 () {56 vars in 1122 bytes} [Mon Oct 3 12:26:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:14.306432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:14.373008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461d819-0818-4adb-991c-6251d95af7ee None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:14.379476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:14.410081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6898c-35cb-4db0-895d-043b7467a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:14.410692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6898c-35cb-4db0-895d-043b7467a157 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:14.410974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6898c-35cb-4db0-895d-043b7467a157 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:14.411480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6898c-35cb-4db0-895d-043b7467a157 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:14.411843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6898c-35cb-4db0-895d-043b7467a157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:14.413216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6898c-35cb-4db0-895d-043b7467a157 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:14.418388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e99f7-dadd-4442-9783-f30bc4156201 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:14.420295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 508/1006] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:26:14 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:26:14.458720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e3fd8-bbf7-4028-b84a-c46e6687f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:14.459362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e3fd8-bbf7-4028-b84a-c46e6687f6f6 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:14.459641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e3fd8-bbf7-4028-b84a-c46e6687f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:14.459919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e3fd8-bbf7-4028-b84a-c46e6687f6f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:14.460605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e3fd8-bbf7-4028-b84a-c46e6687f6f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:14.462042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e3fd8-bbf7-4028-b84a-c46e6687f6f6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:14.481871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 499/1007] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:26:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:26:14.663629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032593af-eeb6-4f41-b17c-e3c176a3f595 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:14.663959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032593af-eeb6-4f41-b17c-e3c176a3f595 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:14.664197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032593af-eeb6-4f41-b17c-e3c176a3f595 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:14.666131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 509/1008] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:14.671654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710cb1-7102-4463-b71f-223ae6242959 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:14.671950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710cb1-7102-4463-b71f-223ae6242959 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:14.672212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710cb1-7102-4463-b71f-223ae6242959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:14.691534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-25710cb1-7102-4463-b71f-223ae6242959 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:14.692740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-25710cb1-7102-4463-b71f-223ae6242959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:14.771638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 500/1009] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:14 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:15.056089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032593af-eeb6-4f41-b17c-e3c176a3f595 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:15.148298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:15.168159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032593af-eeb6-4f41-b17c-e3c176a3f595 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:15.204473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab72688-34cb-418a-9945-4bf78df6abc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:15.205084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab72688-34cb-418a-9945-4bf78df6abc1 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:15.205372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab72688-34cb-418a-9945-4bf78df6abc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:15.205713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab72688-34cb-418a-9945-4bf78df6abc1 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:15.206379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab72688-34cb-418a-9945-4bf78df6abc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:15.207763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab72688-34cb-418a-9945-4bf78df6abc1 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:15.229567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 510/1010] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:26:15 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:26:16.614233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4236-7fbe-47cc-89d6-bdaa7a93bea6 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:16.614810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4236-7fbe-47cc-89d6-bdaa7a93bea6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:16.614810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4236-7fbe-47cc-89d6-bdaa7a93bea6 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:16.616262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 501/1011] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:16.621372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2e683-9b92-4e9e-ac4b-463b89170a93 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:16.621832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2e683-9b92-4e9e-ac4b-463b89170a93 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:16.622020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2e683-9b92-4e9e-ac4b-463b89170a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:16.640022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e3d2e683-9b92-4e9e-ac4b-463b89170a93 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:16.641210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e3d2e683-9b92-4e9e-ac4b-463b89170a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:16.682738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aff91d-a6cb-4784-8ad7-83cd6925c6c3 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:16.683088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aff91d-a6cb-4784-8ad7-83cd6925c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:16.683296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aff91d-a6cb-4784-8ad7-83cd6925c6c3 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:16.684748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 502/1012] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:26:16.689992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1ceeb-f09d-4a01-871f-52664060b226 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:16.690263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1ceeb-f09d-4a01-871f-52664060b226 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:16.690543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1ceeb-f09d-4a01-871f-52664060b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:16.711477 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-24a1ceeb-f09d-4a01-871f-52664060b226 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:16.713216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-24a1ceeb-f09d-4a01-871f-52664060b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:16.729949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 511/1013] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:16.764027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:16.789552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 503/1014] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:17.001861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2e683-9b92-4e9e-ac4b-463b89170a93 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:17.059899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1ceeb-f09d-4a01-871f-52664060b226 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:17.075796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:17.110058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2e683-9b92-4e9e-ac4b-463b89170a93 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:17.152915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:17.153623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:17.154022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:17.154297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:17.154901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:17.156332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:17.165550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:17.166702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:17.167625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 512/1015] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:17.172609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:17.179048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1ceeb-f09d-4a01-871f-52664060b226 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:17.220494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8788c9-62d1-4dd3-8580-a3f67a87ec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:17.221480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8788c9-62d1-4dd3-8580-a3f67a87ec34 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:17.222012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8788c9-62d1-4dd3-8580-a3f67a87ec34 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:17.222449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8788c9-62d1-4dd3-8580-a3f67a87ec34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:17.223739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8788c9-62d1-4dd3-8580-a3f67a87ec34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:17.225566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8788c9-62d1-4dd3-8580-a3f67a87ec34 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:17.227728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 504/1016] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:17.234089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8788c9-62d1-4dd3-8580-a3f67a87ec34 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:17.279921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d109-1e55-4ebe-a41f-fe4ab80274ec None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:17.293764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:17.319402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:17.320171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:17.320523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:17.320873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:17.322121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:17.322429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:17.323846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:17.326225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:17.335969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 513/1017] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:26:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:17.336955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:17.372703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8788c9-62d1-4dd3-8580-a3f67a87ec34 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:17.416255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271728fa-5103-4ea2-8b9a-5d27e17424c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:17.417705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271728fa-5103-4ea2-8b9a-5d27e17424c5 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:17.418444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271728fa-5103-4ea2-8b9a-5d27e17424c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:17.419202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271728fa-5103-4ea2-8b9a-5d27e17424c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:17.420734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271728fa-5103-4ea2-8b9a-5d27e17424c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:17.423565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271728fa-5103-4ea2-8b9a-5d27e17424c5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:17.461920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 505/1018] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:26:17 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:26:17.463177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b236e5-8ade-4558-a1aa-f2bc59826881 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:17.463460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b236e5-8ade-4558-a1aa-f2bc59826881 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:17.463732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b236e5-8ade-4558-a1aa-f2bc59826881 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:17.464751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad3e8-6903-455b-a49c-16763ad6efc4 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:17.465554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 506/1019] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:17.470839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391588f2-3a40-4834-a87c-d9e8c9f24c79 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:17.471159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391588f2-3a40-4834-a87c-d9e8c9f24c79 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:17.471505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391588f2-3a40-4834-a87c-d9e8c9f24c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:17.503321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-391588f2-3a40-4834-a87c-d9e8c9f24c79 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:17.504597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-391588f2-3a40-4834-a87c-d9e8c9f24c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:17.516170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:17.516784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:17.517064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:17.517336 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:17.518002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:17.518309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:17.519729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:17.525227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 514/1020] 10.222.0.17 () {56 vars in 1112 bytes} [Mon Oct 3 12:26:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:17.531417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:17.586053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 507/1021] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:17 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:17.600758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:17.645731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da59141-7ec3-4315-b4e6-9b9485011a6b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:17.681931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d18b1d-86ab-4497-a66b-1e6fca6b54df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:17.682669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18b1d-86ab-4497-a66b-1e6fca6b54df None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:17.682849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18b1d-86ab-4497-a66b-1e6fca6b54df None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:17.683117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18b1d-86ab-4497-a66b-1e6fca6b54df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:17.683789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d18b1d-86ab-4497-a66b-1e6fca6b54df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:17.685195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d18b1d-86ab-4497-a66b-1e6fca6b54df None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:17.718245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 515/1022] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:26:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:26:17.860309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391588f2-3a40-4834-a87c-d9e8c9f24c79 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:17.902253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:18.004662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391588f2-3a40-4834-a87c-d9e8c9f24c79 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:18.050560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:18.051207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:18.051484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:18.051753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] PATH_INFO: `/v3/services/image` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:18.052334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:18.053747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:18.063558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:18.064746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:18.065676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 508/1023] 10.222.0.17 () {56 vars in 1105 bytes} [Mon Oct 3 12:26:17 2022] GET /identity/v3/services/image => generated 86 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:18.072038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d18b1d-86ab-4497-a66b-1e6fca6b54df None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:18.178028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d18b1d-86ab-4497-a66b-1e6fca6b54df None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:18.200911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:18.218087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:18.218698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:18.218977 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:18.219246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:18.219902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] RBAC: Adding query filter params (name=image) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:18.220207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:18.221607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:18.227274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 516/1024] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:18.233291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:18.331582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:18.342179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb9ad5-07c8-436a-afca-a8b90d728f5b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:18.378575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:18.379196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:18.379476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:18.379752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:18.380385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] RBAC: Adding query filter params (type=image) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:18.380692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:18.382122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:18.392347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 509/1025] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:18.393346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:18.499107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274d063-cf0f-4b63-bcad-b5c937e11cee None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:18.534557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14021182-6905-4726-a48a-b28ef6e7f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:18.535169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021182-6905-4726-a48a-b28ef6e7f833 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:18.535568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021182-6905-4726-a48a-b28ef6e7f833 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:18.535749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14021182-6905-4726-a48a-b28ef6e7f833 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:18.536422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14021182-6905-4726-a48a-b28ef6e7f833 None admin] RBAC: Adding query filter params (interface=public, service_id=fbe2d6cbe3c247788935cf9b210ec777, region_id=RegionOne) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:18.536731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14021182-6905-4726-a48a-b28ef6e7f833 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:18.538129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14021182-6905-4726-a48a-b28ef6e7f833 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:18.544158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 517/1026] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Oct 3 12:26:18 2022] GET /identity/v3/endpoints?service_id=fbe2d6cbe3c247788935cf9b210ec777&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:18.549589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:18.658826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b7a83-09cc-4a06-8d50-f24ef28f4868 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:18.704392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b09b7b-1930-4f6a-8c4f-b908bd324591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:18.705390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b09b7b-1930-4f6a-8c4f-b908bd324591 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:18.706072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b09b7b-1930-4f6a-8c4f-b908bd324591 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:18.706542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b09b7b-1930-4f6a-8c4f-b908bd324591 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:18.707342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b09b7b-1930-4f6a-8c4f-b908bd324591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:18.708877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b09b7b-1930-4f6a-8c4f-b908bd324591 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:18.725549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 510/1027] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:26:18 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:26:19.755316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410224-9226-4650-b598-2a19f97c07c9 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:19.755896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410224-9226-4650-b598-2a19f97c07c9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:19.755896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92410224-9226-4650-b598-2a19f97c07c9 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:19.757374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 518/1028] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:19.762897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac194-4af2-46f1-b5d9-3609fddfc12b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:19.763488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac194-4af2-46f1-b5d9-3609fddfc12b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:19.763488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac194-4af2-46f1-b5d9-3609fddfc12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:19.782159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9d1ac194-4af2-46f1-b5d9-3609fddfc12b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:19.783374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9d1ac194-4af2-46f1-b5d9-3609fddfc12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:19.799497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:19.854611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 511/1029] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:20.040107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6533-dd60-44ba-bc2e-2f1b5e16a3c4 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.040446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6533-dd60-44ba-bc2e-2f1b5e16a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.040629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6533-dd60-44ba-bc2e-2f1b5e16a3c4 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.042152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 519/1030] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:20.047376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7aabd-7eb7-41ed-a6d7-c62a4a918a41 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.047666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7aabd-7eb7-41ed-a6d7-c62a4a918a41 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.047942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7aabd-7eb7-41ed-a6d7-c62a4a918a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.066833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-43b7aabd-7eb7-41ed-a6d7-c62a4a918a41 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:20.068025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-43b7aabd-7eb7-41ed-a6d7-c62a4a918a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:20.127366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a6533-dd60-44ba-bc2e-2f1b5e16a3c4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:20.141572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 512/1031] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:20.181768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:20.240549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a6533-dd60-44ba-bc2e-2f1b5e16a3c4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:20.276404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721faf3d-711a-4cd4-9307-b65d36a24028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:20.277046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721faf3d-711a-4cd4-9307-b65d36a24028 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.277325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721faf3d-711a-4cd4-9307-b65d36a24028 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.277630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721faf3d-711a-4cd4-9307-b65d36a24028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.278770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721faf3d-711a-4cd4-9307-b65d36a24028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:20.280209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721faf3d-711a-4cd4-9307-b65d36a24028 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:20.282064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 520/1032] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:20.287674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7aabd-7eb7-41ed-a6d7-c62a4a918a41 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:20.373894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:20.395561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7aabd-7eb7-41ed-a6d7-c62a4a918a41 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:20.415295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721faf3d-711a-4cd4-9307-b65d36a24028 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:20.439280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12bdfa-732e-40e0-8668-0b48a1c02ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:20.439925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12bdfa-732e-40e0-8668-0b48a1c02ed3 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.440207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12bdfa-732e-40e0-8668-0b48a1c02ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.440484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12bdfa-732e-40e0-8668-0b48a1c02ed3 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.441178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12bdfa-732e-40e0-8668-0b48a1c02ed3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:20.442701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12bdfa-732e-40e0-8668-0b48a1c02ed3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:20.467739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 513/1033] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:26:20 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:26:20.540112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721faf3d-711a-4cd4-9307-b65d36a24028 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:20.558603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:20.588678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c452d3b-6949-4b5c-88a2-12bebcab19e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:20.589329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c452d3b-6949-4b5c-88a2-12bebcab19e5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.589646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c452d3b-6949-4b5c-88a2-12bebcab19e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.589922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c452d3b-6949-4b5c-88a2-12bebcab19e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.602610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c452d3b-6949-4b5c-88a2-12bebcab19e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-5c452d3b-6949-4b5c-88a2-12bebcab19e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:20.608180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:20.609182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:20.614816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 521/1034] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Oct 3 12:26:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:20.616456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12bdfa-732e-40e0-8668-0b48a1c02ed3 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:20.733474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12bdfa-732e-40e0-8668-0b48a1c02ed3 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:20.771579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399f3d5-3a60-4734-af7e-5524189ecf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:20.772218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399f3d5-3a60-4734-af7e-5524189ecf33 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.772470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399f3d5-3a60-4734-af7e-5524189ecf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.772743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399f3d5-3a60-4734-af7e-5524189ecf33 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.773413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399f3d5-3a60-4734-af7e-5524189ecf33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:20.773751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399f3d5-3a60-4734-af7e-5524189ecf33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:20.775749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399f3d5-3a60-4734-af7e-5524189ecf33 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:20.778707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:20.790925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 514/1035] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Oct 3 12:26:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:20.792866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c452d3b-6949-4b5c-88a2-12bebcab19e5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:20.911839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c452d3b-6949-4b5c-88a2-12bebcab19e5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:20.926899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8af6dd-9d7f-4cd8-80cb-a10beb343ac7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.927206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8af6dd-9d7f-4cd8-80cb-a10beb343ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.927453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8af6dd-9d7f-4cd8-80cb-a10beb343ac7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.928941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 515/1036] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:26:20.934842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66946-3943-44c7-93f6-3b6a6485b1cc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.935129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66946-3943-44c7-93f6-3b6a6485b1cc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.935405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a66946-3943-44c7-93f6-3b6a6485b1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.949328 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:20.949916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:20.950197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:20.950471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:20.954323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-17a66946-3943-44c7-93f6-3b6a6485b1cc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:20.956085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-17a66946-3943-44c7-93f6-3b6a6485b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:20.961983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:20.963445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:20.978828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:20.979857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:20.980774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:20.980774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:20.980774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:20.980774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 522/1037] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:20.985712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.016177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:21.045902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 516/1038] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:21.093740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750dd3d-55c2-435a-a438-10ec2e6004ee None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:21.128282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:21.128892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:21.129171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:21.129446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:21.130121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:21.130427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:21.131809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:21.144855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 523/1039] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:21.150675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66946-3943-44c7-93f6-3b6a6485b1cc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.255326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a66946-3943-44c7-93f6-3b6a6485b1cc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:21.282712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:21.293091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:21.293770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:21.294161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:21.294958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:21.302443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:21.303892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:21.308137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:26:21.323737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:21.324785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:21.326263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 517/1040] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:26:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:21.333424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.408400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:21.423093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a328fa-2952-4e96-a8b1-8e16448dec03 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:21.461055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:21.461772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:21.462053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:21.462327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] PATH_INFO: `/v3/services/image` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:21.462851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aff2f-2696-4448-a5ed-f248147d8e78 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:21.462962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:21.464383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:21.473397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:21.474456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:21.475309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 524/1041] 10.222.0.17 () {56 vars in 1105 bytes} [Mon Oct 3 12:26:21 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:21.481383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.504616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:21.505227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:21.505595 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:21.505814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:21.506640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:21.506969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:21.508694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:21.534648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 518/1042] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:26:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:21.535763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.589438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:21.596259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c95ce8-df67-4251-8e99-a47bd79f229f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:21.632705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:21.633349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:21.633663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:21.633935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:21.634559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] RBAC: Adding query filter params (name=image) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:21.634863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:21.636235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:21.641623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 525/1043] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:21.647346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.651901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e523d9-c129-483c-b714-f41c26f2f075 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:21.668837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:21.698276 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009315bc-7b2d-4ddd-9d01-56ce89fb385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:21.699554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009315bc-7b2d-4ddd-9d01-56ce89fb385d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:21.700030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009315bc-7b2d-4ddd-9d01-56ce89fb385d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:21.700472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009315bc-7b2d-4ddd-9d01-56ce89fb385d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:21.783159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98810787-15b6-4287-b3ff-c7dffad66f8f None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:21.802890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009315bc-7b2d-4ddd-9d01-56ce89fb385d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:21.805212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009315bc-7b2d-4ddd-9d01-56ce89fb385d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:21.838040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:21.839003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:21.839464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:21.839840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:21.840891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] RBAC: Adding query filter params (type=image) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:21.841418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:21.843816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:21.853561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 526/1044] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:21.858684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.877913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:21.944001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 519/1045] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:26:21.949110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:21.950196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009315bc-7b2d-4ddd-9d01-56ce89fb385d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:21.972960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073ff91-e646-4e58-a3bf-e03a5d3caa11 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:22.009023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e807-3c1d-4cd0-bb37-707acce81476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:22.009671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e807-3c1d-4cd0-bb37-707acce81476 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:22.009956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e807-3c1d-4cd0-bb37-707acce81476 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:22.010231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e807-3c1d-4cd0-bb37-707acce81476 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:22.010908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490e807-3c1d-4cd0-bb37-707acce81476 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:22.012276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490e807-3c1d-4cd0-bb37-707acce81476 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:22.036122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 527/1046] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:26:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:26:22.080307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009315bc-7b2d-4ddd-9d01-56ce89fb385d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:22.128224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:22.128876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:22.129150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:22.129407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:22.141592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:22.143165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:22.145268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:22.161960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:22.163131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:22.164034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:22.164034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:22.164034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:22.164034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 520/1047] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:22.169555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e807-3c1d-4cd0-bb37-707acce81476 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:22.288646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e807-3c1d-4cd0-bb37-707acce81476 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:22.324665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:22.325281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:22.325582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:22.325859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:22.326501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:22.326802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:22.328169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:22.331338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:22.348250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 528/1048] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:22.349564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:22.459806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fb6ad-c178-4a12-9295-173d6ca2d1ed None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:22.495380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:22.496026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:22.496311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:22.496589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:22.503714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:22.505199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:26:22.517793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:22.518809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:22.519782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:26:22.519782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:26:22.519782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:26:22.519782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:26:22.519782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:26:22.519782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:26:22.519782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:22.519782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:22.521589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 521/1049] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:22.524900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:22.637017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901055-ffec-4b86-a0ba-bb876470de2c None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:22.673591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0948-da85-4797-a62a-92ddc5691ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:22.674211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0948-da85-4797-a62a-92ddc5691ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:22.674531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0948-da85-4797-a62a-92ddc5691ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:22.674834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0948-da85-4797-a62a-92ddc5691ac9 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:22.675459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0948-da85-4797-a62a-92ddc5691ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:22.675772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0948-da85-4797-a62a-92ddc5691ac9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:22.677219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0948-da85-4797-a62a-92ddc5691ac9 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:22.698650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 529/1050] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:22.700248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:22.732765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c116-4750-40a1-8222-0f9ed3c06e10 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:22.733062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c116-4750-40a1-8222-0f9ed3c06e10 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:22.733344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520c116-4750-40a1-8222-0f9ed3c06e10 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:22.734927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 530/1051] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:26:22.740762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54b49-6282-43ae-8c05-26ccf43508b4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:22.741312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54b49-6282-43ae-8c05-26ccf43508b4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:22.741793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf54b49-6282-43ae-8c05-26ccf43508b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:22.760940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-9cf54b49-6282-43ae-8c05-26ccf43508b4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:22.762504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9cf54b49-6282-43ae-8c05-26ccf43508b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:22.768668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:22.825798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:22.830533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24542d53-bb37-4772-a0f3-1883ec73c059 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:22.847170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 531/1052] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:22.870277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:22.870840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:22.871118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:22.871389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:22.872122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] RBAC: Adding query filter params (role.id=0cd23314a409488b99c3ed582dd894d9, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=589b89539f8d43e993201fab13cd443a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:22.872429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:22.873890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:22.889874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 522/1053] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:26:22 2022] GET /identity/v3/role_assignments?user.id=589b89539f8d43e993201fab13cd443a&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=0cd23314a409488b99c3ed582dd894d9 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:23.119954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf54b49-6282-43ae-8c05-26ccf43508b4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:23.228551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf54b49-6282-43ae-8c05-26ccf43508b4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:23.265118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc08e-552d-4661-a116-ab66f42683c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:23.265722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc08e-552d-4661-a116-ab66f42683c8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:23.266003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc08e-552d-4661-a116-ab66f42683c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:23.266275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc08e-552d-4661-a116-ab66f42683c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:23.277758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dc08e-552d-4661-a116-ab66f42683c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-d54dc08e-552d-4661-a116-ab66f42683c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:23.282536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:23.283503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:23.284375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 532/1054] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:26:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:23.291747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:23.396687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368779-8fde-45d2-a52c-a13f1d4432ff None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:23.415560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:23.435374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:23.435872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:23.436155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:23.436435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:23.437096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:23.437402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:23.438795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:23.453062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 523/1055] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:23.454798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc08e-552d-4661-a116-ab66f42683c8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:23.510532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:23.568568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc08e-552d-4661-a116-ab66f42683c8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:23.605196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953a252-6ce0-43dc-9845-2d6cabe32129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:23.605873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953a252-6ce0-43dc-9845-2d6cabe32129 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:23.606157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953a252-6ce0-43dc-9845-2d6cabe32129 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:23.606433 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953a252-6ce0-43dc-9845-2d6cabe32129 None admin] PATH_INFO: `/v3/users/d496d7e362974a30b1adc564a6635632` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:23.623153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953a252-6ce0-43dc-9845-2d6cabe32129 None admin] RBAC: Authorizing `identity:get_user(user_id=d496d7e362974a30b1adc564a6635632)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:23.624621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953a252-6ce0-43dc-9845-2d6cabe32129 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:23.631055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 533/1056] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:23 2022] GET /identity/v3/users/d496d7e362974a30b1adc564a6635632 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:23.632088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:23.766223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88e0fb-d285-4265-9b6c-6aa21468a2cb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:23.808745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28157eb5-316f-4acb-81bc-513b6b4bccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:23.809379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157eb5-316f-4acb-81bc-513b6b4bccdc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:23.809901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157eb5-316f-4acb-81bc-513b6b4bccdc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:23.810068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157eb5-316f-4acb-81bc-513b6b4bccdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:23.864007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:23.889632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28157eb5-316f-4acb-81bc-513b6b4bccdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:23.891083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28157eb5-316f-4acb-81bc-513b6b4bccdc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:23.995465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 524/1057] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:26:24.001091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953a252-6ce0-43dc-9845-2d6cabe32129 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:24.108867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953a252-6ce0-43dc-9845-2d6cabe32129 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:24.111596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:24.147646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcadbcd-4340-4727-a05a-f58e03e5f698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:24.148283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcadbcd-4340-4727-a05a-f58e03e5f698 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:24.148568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcadbcd-4340-4727-a05a-f58e03e5f698 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:24.148898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcadbcd-4340-4727-a05a-f58e03e5f698 None admin] PATH_INFO: `/v3/projects/dd9b878f91ca45729fe09754ab88c1de` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:24.150094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcadbcd-4340-4727-a05a-f58e03e5f698 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9b878f91ca45729fe09754ab88c1de)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:24.151537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcadbcd-4340-4727-a05a-f58e03e5f698 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:24.157620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 534/1058] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:24 2022] GET /identity/v3/projects/dd9b878f91ca45729fe09754ab88c1de => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:24.160126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28157eb5-316f-4acb-81bc-513b6b4bccdc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:24.251450 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:24.272770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28157eb5-316f-4acb-81bc-513b6b4bccdc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:24.309793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde03e0-ea17-4f65-b2d1-edcb19a6bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:24.310415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde03e0-ea17-4f65-b2d1-edcb19a6bb44 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:24.310699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde03e0-ea17-4f65-b2d1-edcb19a6bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:24.311045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde03e0-ea17-4f65-b2d1-edcb19a6bb44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:24.311703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde03e0-ea17-4f65-b2d1-edcb19a6bb44 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=dd9b878f91ca45729fe09754ab88c1de, user.id=d496d7e362974a30b1adc564a6635632) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:24.312015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde03e0-ea17-4f65-b2d1-edcb19a6bb44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:24.313442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde03e0-ea17-4f65-b2d1-edcb19a6bb44 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:24.325607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 525/1059] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:26:24 2022] GET /identity/v3/role_assignments?user.id=d496d7e362974a30b1adc564a6635632&scope.project.id=dd9b878f91ca45729fe09754ab88c1de&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:24.340112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8a26-4a86-4eec-b833-a827d16cb036 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:24.340401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8a26-4a86-4eec-b833-a827d16cb036 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:24.340680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8a26-4a86-4eec-b833-a827d16cb036 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:24.342141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 535/1060] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:24.348132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7e8d6-7eb3-4895-84b6-2fd367acb659 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:24.348424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7e8d6-7eb3-4895-84b6-2fd367acb659 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:24.348701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc7e8d6-7eb3-4895-84b6-2fd367acb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:24.369337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-dfc7e8d6-7eb3-4895-84b6-2fd367acb659 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:24.370513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dfc7e8d6-7eb3-4895-84b6-2fd367acb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:24.457774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 526/1061] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:24.717808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8a26-4a86-4eec-b833-a827d16cb036 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:24.831052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8a26-4a86-4eec-b833-a827d16cb036 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:24.868923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21471c-2229-4e15-b03b-4eba55ab09ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:24.869570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21471c-2229-4e15-b03b-4eba55ab09ab None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:24.869857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21471c-2229-4e15-b03b-4eba55ab09ab None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:24.870135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21471c-2229-4e15-b03b-4eba55ab09ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:24.916606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:24.946717 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21471c-2229-4e15-b03b-4eba55ab09ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:24.948094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21471c-2229-4e15-b03b-4eba55ab09ab None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:25.059800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 536/1062] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:26:25.065561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7e8d6-7eb3-4895-84b6-2fd367acb659 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:25.100509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a668f9-6399-4c12-b7d5-a911131a48f5 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:25.100836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a668f9-6399-4c12-b7d5-a911131a48f5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:25.101070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a668f9-6399-4c12-b7d5-a911131a48f5 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:25.102783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 537/1063] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:26:25.107906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef3a8-da48-4eaa-91b2-bb03901c65f8 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:25.108191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef3a8-da48-4eaa-91b2-bb03901c65f8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:25.108464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef3a8-da48-4eaa-91b2-bb03901c65f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:25.130557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1a0ef3a8-da48-4eaa-91b2-bb03901c65f8 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:25.132348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1a0ef3a8-da48-4eaa-91b2-bb03901c65f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:25.147058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:25.174385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc7e8d6-7eb3-4895-84b6-2fd367acb659 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:25.214699 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 538/1064] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:25.216426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:25.217191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:25.217542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:25.217896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:25.229737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:25.231190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:25.247184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:25.248402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:25.249306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:25.249306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:25.249306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:25.249306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 527/1065] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:25.254276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ef3a8-da48-4eaa-91b2-bb03901c65f8 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:25.257116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:25.360668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ef3a8-da48-4eaa-91b2-bb03901c65f8 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:25.396538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:25.397156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:25.397440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:25.397745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:25.398388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:25.398732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:25.400106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:25.417541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 539/1066] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:25.494578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:25.617921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea286306-bb03-48d4-901b-f6cb6f9edfe8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:25.650092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:25.660236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239236d3-fe39-4251-8cf2-c434c39072d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:25.660880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239236d3-fe39-4251-8cf2-c434c39072d5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:25.661163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239236d3-fe39-4251-8cf2-c434c39072d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:25.661441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239236d3-fe39-4251-8cf2-c434c39072d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:25.672791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239236d3-fe39-4251-8cf2-c434c39072d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-239236d3-fe39-4251-8cf2-c434c39072d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:25.678665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:25.679647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:25.681015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 528/1067] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Oct 3 12:26:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:25.686570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:25.763097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:25.807506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139f684-8304-4e84-9068-53c093f8e1c2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:25.845669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:25.846290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:25.846573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:25.846846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:25.847515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:25.847823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:25.849208 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:25.858597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 540/1068] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Oct 3 12:26:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:25.864923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239236d3-fe39-4251-8cf2-c434c39072d5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:25.971682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239236d3-fe39-4251-8cf2-c434c39072d5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:26.006221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:26.006851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:26.007132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:26.007403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:26.018492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:26.019876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:26.034270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:26.035359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:26.036863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:26.036863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:26.036863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:26.036863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 529/1069] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:26.041845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:26.145220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec327b-d237-4e21-aa43-caecc515ac69 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:26.170045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:26.181109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:26.181744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:26.182029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:26.182301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:26.182932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:26.183232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:26.184589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:26.196510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 541/1070] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:26.201970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:26.244033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:26.307020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ff66-68b2-4354-9c22-10034857a84b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:26.340862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dada0-4d38-455c-9433-e79c587826fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:26.341496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dada0-4d38-455c-9433-e79c587826fb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:26.341807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dada0-4d38-455c-9433-e79c587826fb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:26.342086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dada0-4d38-455c-9433-e79c587826fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:26.349785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dada0-4d38-455c-9433-e79c587826fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:26.351224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dada0-4d38-455c-9433-e79c587826fb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-010dada0-4d38-455c-9433-e79c587826fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:26:26.363440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:26.364509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:26.365459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 530/1071] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:26:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:26.370814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:26.477115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63ce61-fc1f-49e6-b3f1-8ec46b939ccc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:26.498048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659b591-31bd-4a01-a04b-17cc43c9b207 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:26.498338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659b591-31bd-4a01-a04b-17cc43c9b207 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:26.498615 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659b591-31bd-4a01-a04b-17cc43c9b207 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:26.499935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 531/1072] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:26:26.504910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e5e6-5c06-47c1-8ea6-74e9a247c438 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:26.505188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e5e6-5c06-47c1-8ea6-74e9a247c438 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:26.505458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0e5e6-5c06-47c1-8ea6-74e9a247c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:26.511925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:26.512542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:26.512823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:26.513099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:26.513916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:26.514230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:26.515752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:26.525124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3eb0e5e6-5c06-47c1-8ea6-74e9a247c438 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:26.526428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3eb0e5e6-5c06-47c1-8ea6-74e9a247c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:26.534759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 542/1073] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:26:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:26.540187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:26.584790 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:26.596874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 532/1074] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:26:26.642862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a386e-2b31-4b4b-834d-5b1a0bd3425e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:26.676969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:26.677630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:26.677915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:26.678191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:26.691253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:26.692722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:26.708909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:26.709983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:26.710929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:26.710929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:26.710929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:26.710929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 543/1075] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:26.716511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e5e6-5c06-47c1-8ea6-74e9a247c438 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:26.745662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:26.819150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0e5e6-5c06-47c1-8ea6-74e9a247c438 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:26.855455 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:26.855991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:26.856277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:26.856557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:26.857206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:26.857533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:26.858918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:26.865961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:26.872404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 533/1076] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:26.879113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:26.964992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:26.972125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:26.973002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef9488-bea3-4d08-aa94-25dc4b35c2cf None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:26.984484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c009c55-3075-427d-aa08-4acfd9448d1b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:27.008889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0555144-733c-4a60-8f11-5d2ae1cf0b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:27.009535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555144-733c-4a60-8f11-5d2ae1cf0b0d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:27.009846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555144-733c-4a60-8f11-5d2ae1cf0b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:27.010123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0555144-733c-4a60-8f11-5d2ae1cf0b0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:27.019761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:27.020395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:27.020676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:27.020952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:27.021331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0555144-733c-4a60-8f11-5d2ae1cf0b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-d0555144-733c-4a60-8f11-5d2ae1cf0b0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:27.026245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:27.027301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:27.028666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 544/1077] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:27.029691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:27.029691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:27.033353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0555144-733c-4a60-8f11-5d2ae1cf0b0d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:26:27.041043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:27.042241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:27.043274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 534/1078] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:27.048363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:27.139720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0555144-733c-4a60-8f11-5d2ae1cf0b0d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:27.153314 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112ba21-fbef-4224-b786-7256840dcec7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:27.186914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:27.187478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:27.187705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:27.187799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:27.188037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:27.188138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:27.188354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:27.188630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:27.188731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:27.188983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:27.189311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:27.189650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:27.190388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:27.191065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:27.199594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 545/1079] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:27.204086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 535/1080] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:27.205432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:27.209677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:27.220519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:27.224027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:27.309961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b7b43-3442-438b-b4f8-de84248d0ded None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:27.310998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b38b16-1bfe-4159-b302-3d7931614f71 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:27.343855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f1aa-8211-4241-a7ef-1a69709f60b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:27.344063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf9123-4fc6-4100-a73c-50d6ac5977eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:27.344491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f1aa-8211-4241-a7ef-1a69709f60b5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:27.344617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9123-4fc6-4100-a73c-50d6ac5977eb None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:27.344775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f1aa-8211-4241-a7ef-1a69709f60b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:27.344870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9123-4fc6-4100-a73c-50d6ac5977eb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:27.345049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f1aa-8211-4241-a7ef-1a69709f60b5 None admin] PATH_INFO: `/v3/users/d496d7e362974a30b1adc564a6635632` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:27.345141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9123-4fc6-4100-a73c-50d6ac5977eb None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/589b89539f8d43e993201fab13cd443a/roles/0cd23314a409488b99c3ed582dd894d9` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:27.346192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119f1aa-8211-4241-a7ef-1a69709f60b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d496d7e362974a30b1adc564a6635632)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:27.347310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf9123-4fc6-4100-a73c-50d6ac5977eb None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=589b89539f8d43e993201fab13cd443a, role_id=0cd23314a409488b99c3ed582dd894d9)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:27.347623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119f1aa-8211-4241-a7ef-1a69709f60b5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:27.348720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf9123-4fc6-4100-a73c-50d6ac5977eb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:27.349217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 546/1081] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:27 2022] GET /identity/v3/users/d496d7e362974a30b1adc564a6635632 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:27.355633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f1aa-8211-4241-a7ef-1a69709f60b5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:27.363562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 536/1082] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:26:27 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/589b89539f8d43e993201fab13cd443a/roles/0cd23314a409488b99c3ed582dd894d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:26:27.455729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:27.475317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f1aa-8211-4241-a7ef-1a69709f60b5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:27.515627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81bafb-f22d-4673-bc9d-d4983b9622ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:27.516295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81bafb-f22d-4673-bc9d-d4983b9622ab None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:27.516580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81bafb-f22d-4673-bc9d-d4983b9622ab None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:27.516864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81bafb-f22d-4673-bc9d-d4983b9622ab None admin] PATH_INFO: `/v3/projects/dd9b878f91ca45729fe09754ab88c1de` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:27.518224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81bafb-f22d-4673-bc9d-d4983b9622ab None admin] RBAC: Authorizing `identity:get_project(project_id=dd9b878f91ca45729fe09754ab88c1de)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:27.519732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81bafb-f22d-4673-bc9d-d4983b9622ab None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:27.521532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 547/1083] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:27 2022] GET /identity/v3/projects/dd9b878f91ca45729fe09754ab88c1de => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:27.528095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf9123-4fc6-4100-a73c-50d6ac5977eb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:27.606048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:27.642485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf9123-4fc6-4100-a73c-50d6ac5977eb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:27.679189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71008e0b-d7b1-4d00-9e66-7640870d6db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:27.679867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008e0b-d7b1-4d00-9e66-7640870d6db6 None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:27.680774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008e0b-d7b1-4d00-9e66-7640870d6db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:27.680774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71008e0b-d7b1-4d00-9e66-7640870d6db6 None admin] PATH_INFO: `/v3/projects/dd9b878f91ca45729fe09754ab88c1de/users/d496d7e362974a30b1adc564a6635632/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:27.682412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71008e0b-d7b1-4d00-9e66-7640870d6db6 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9b878f91ca45729fe09754ab88c1de, user_id=d496d7e362974a30b1adc564a6635632, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:27.683870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71008e0b-d7b1-4d00-9e66-7640870d6db6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:27.705621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 537/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:26:27 2022] PUT /identity/v3/projects/dd9b878f91ca45729fe09754ab88c1de/users/d496d7e362974a30b1adc564a6635632/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:26:29.534987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2441-657a-4f4d-aa89-29ad46c48992 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:29.535533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2441-657a-4f4d-aa89-29ad46c48992 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:29.535533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2441-657a-4f4d-aa89-29ad46c48992 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:29.536854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 548/1085] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:29.542731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766759d7-0827-47e7-a2fa-59d9fe12cbf2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:29.543141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766759d7-0827-47e7-a2fa-59d9fe12cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:29.543413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766759d7-0827-47e7-a2fa-59d9fe12cbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:29.565210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-766759d7-0827-47e7-a2fa-59d9fe12cbf2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:29.566455 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-766759d7-0827-47e7-a2fa-59d9fe12cbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:29.634389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 538/1086] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:29.847083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d49a9f-a18b-4dc8-a799-3c0a54db7578 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:29.847269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d49a9f-a18b-4dc8-a799-3c0a54db7578 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:29.847617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d49a9f-a18b-4dc8-a799-3c0a54db7578 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:29.848907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 549/1087] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:29.855410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0e24f-9df8-4c0f-a49e-4b826fe87b8d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:29.855709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0e24f-9df8-4c0f-a49e-4b826fe87b8d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:29.855990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0e24f-9df8-4c0f-a49e-4b826fe87b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:29.875332 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4df0e24f-9df8-4c0f-a49e-4b826fe87b8d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:29.876536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4df0e24f-9df8-4c0f-a49e-4b826fe87b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:29.909032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d49a9f-a18b-4dc8-a799-3c0a54db7578 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:29.932112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:29.946907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 539/1088] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:30.016166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d49a9f-a18b-4dc8-a799-3c0a54db7578 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.051045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617581b-2b92-4d1c-a656-738ed9540a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.051682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617581b-2b92-4d1c-a656-738ed9540a92 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.051965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617581b-2b92-4d1c-a656-738ed9540a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.052243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617581b-2b92-4d1c-a656-738ed9540a92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.063510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617581b-2b92-4d1c-a656-738ed9540a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-c617581b-2b92-4d1c-a656-738ed9540a92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:30.068370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:30.069344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:30.070414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 550/1089] 10.222.0.17 () {56 vars in 1120 bytes} [Mon Oct 3 12:26:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:30.075740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0e24f-9df8-4c0f-a49e-4b826fe87b8d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.175062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0e24f-9df8-4c0f-a49e-4b826fe87b8d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.209403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.210040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.210318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.216475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.216475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:30.216475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:30.216475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:30.224297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617581b-2b92-4d1c-a656-738ed9540a92 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.229080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 540/1090] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:30.238384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.242048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:30.289639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:30.330299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617581b-2b92-4d1c-a656-738ed9540a92 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.340275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6090c94-0617-42d1-a891-5cc4e555c441 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.368580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ce9a1-8458-406c-a545-1fabc149afbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.369221 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ce9a1-8458-406c-a545-1fabc149afbf None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.369501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ce9a1-8458-406c-a545-1fabc149afbf None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.369815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ce9a1-8458-406c-a545-1fabc149afbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.377350 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.378009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.378287 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.378558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.379895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ce9a1-8458-406c-a545-1fabc149afbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-fe0ce9a1-8458-406c-a545-1fabc149afbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:30.385163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:30.386129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:30.386966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 551/1091] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:30.389821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:30.391253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:30.392263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ce9a1-8458-406c-a545-1fabc149afbf None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:30.405942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:30.407141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:30.408509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:30.408509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:30.408509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:30.408509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 541/1092] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:30.412613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.467118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:30.500685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ce9a1-8458-406c-a545-1fabc149afbf None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.515624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65403326-fb27-4a4c-91f1-211f6d0d3777 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.517083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:30.534148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.534751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.535033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.535600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.536007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:30.536279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:30.537671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:30.546924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 552/1093] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:30.551516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.552130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.552410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.552686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.552792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.553349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:30.553687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:30.555668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:30.569676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 542/1094] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:30.573055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.652189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29a4a3-9472-4b96-9a8e-358fa9e4b070 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.673755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968df9-2e93-4787-b1aa-31b872cbb0eb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.690049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeac45-712a-4136-ae2d-f2bfa5e6e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.690049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeac45-712a-4136-ae2d-f2bfa5e6e3dd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.690049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeac45-712a-4136-ae2d-f2bfa5e6e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.690049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeac45-712a-4136-ae2d-f2bfa5e6e3dd None admin] PATH_INFO: `/v3/users/d496d7e362974a30b1adc564a6635632` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.690467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeac45-712a-4136-ae2d-f2bfa5e6e3dd None admin] RBAC: Authorizing `identity:get_user(user_id=d496d7e362974a30b1adc564a6635632)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:30.691423 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeac45-712a-4136-ae2d-f2bfa5e6e3dd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:30.693013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 553/1095] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/users/d496d7e362974a30b1adc564a6635632 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:30.698921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeac45-712a-4136-ae2d-f2bfa5e6e3dd None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.701716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:30.708078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.708707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.708987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.709257 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.717247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:30.718655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:26:30.732028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:30.733102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:30.734218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 543/1096] 10.222.0.17 () {56 vars in 1093 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:30.739281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.763100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:30.800730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeac45-712a-4136-ae2d-f2bfa5e6e3dd None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.840314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f07f6-afb7-4578-aaa7-aaa69a5a6cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.840973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f07f6-afb7-4578-aaa7-aaa69a5a6cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.841255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f07f6-afb7-4578-aaa7-aaa69a5a6cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.841646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f07f6-afb7-4578-aaa7-aaa69a5a6cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.841897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ee5f1-209e-43f6-b249-6637ce9c484f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:30.878048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:30.878923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:30.879213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:30.879491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:30.880223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:30.880594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:30.882635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:30.900005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 544/1097] 10.222.0.17 () {56 vars in 1133 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:30.905821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:30.918966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f07f6-afb7-4578-aaa7-aaa69a5a6cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:30.920422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f07f6-afb7-4578-aaa7-aaa69a5a6cc0 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:30.922279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:30.988149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:31.008308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb968f-c717-44fb-b297-9e3de711eafa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:31.021003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 554/1098] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:26:31.027578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f07f6-afb7-4578-aaa7-aaa69a5a6cc0 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:31.043705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb43736-c68b-400e-8d94-dafb5e4d6260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:31.044320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43736-c68b-400e-8d94-dafb5e4d6260 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:31.044603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43736-c68b-400e-8d94-dafb5e4d6260 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:31.044882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43736-c68b-400e-8d94-dafb5e4d6260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:31.113280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb43736-c68b-400e-8d94-dafb5e4d6260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:31.114767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb43736-c68b-400e-8d94-dafb5e4d6260 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:31.128679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f07f6-afb7-4578-aaa7-aaa69a5a6cc0 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:31.130808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:31.165271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de21e-48d1-4d7d-992e-b40c2b4acd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:31.165932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de21e-48d1-4d7d-992e-b40c2b4acd77 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:31.166214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de21e-48d1-4d7d-992e-b40c2b4acd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:31.166489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de21e-48d1-4d7d-992e-b40c2b4acd77 None admin] PATH_INFO: `/v3/projects/dd9b878f91ca45729fe09754ab88c1de` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:31.167685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de21e-48d1-4d7d-992e-b40c2b4acd77 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9b878f91ca45729fe09754ab88c1de)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:31.169135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de21e-48d1-4d7d-992e-b40c2b4acd77 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:31.170809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 555/1099] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:31 2022] GET /identity/v3/projects/dd9b878f91ca45729fe09754ab88c1de => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:31.176949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de21e-48d1-4d7d-992e-b40c2b4acd77 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:31.196424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:31.216708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 545/1100] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 03 12:26:31.222625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb43736-c68b-400e-8d94-dafb5e4d6260 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:31.281533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de21e-48d1-4d7d-992e-b40c2b4acd77 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:31.314202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:31.314807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:31.315086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:31.315367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:31.316080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=dd9b878f91ca45729fe09754ab88c1de, user.id=d496d7e362974a30b1adc564a6635632) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:31.316389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:31.317851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:31.322491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb43736-c68b-400e-8d94-dafb5e4d6260 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:31.324144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 556/1101] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:26:31 2022] GET /identity/v3/role_assignments?user.id=d496d7e362974a30b1adc564a6635632&scope.project.id=dd9b878f91ca45729fe09754ab88c1de&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:31.361464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:31.362150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:31.362431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:31.362703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:31.374404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:31.375874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:26:31.392716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:31.393822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:26:31.394752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:26:31.394752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:26:31.394752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:31.394752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 546/1102] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:26:31.400140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:31.441583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:31.518656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d3f0-a67c-45ce-9a12-7f7ca09265e5 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:31.554656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:31.555604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:31.556086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:31.556405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:31.557063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:31.557368 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:31.558795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:31.572325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 557/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:31.578196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:31.611945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:31.681301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22c6b7-fd49-49ef-bdc1-49bca333a614 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:31.715548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:31.716182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:31.716458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:31.716731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:31.723430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:31.724847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:26:31.736683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:31.737818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:31.738726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 547/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:31.744617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:31.844576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:31.852774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58b51d-e06e-4bfa-a7e0-39657c7834f8 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:31.890879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd712f4-de50-468f-ba2e-e88ec6475b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:31.891486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd712f4-de50-468f-ba2e-e88ec6475b4d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:31.891767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd712f4-de50-468f-ba2e-e88ec6475b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:31.892030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd712f4-de50-468f-ba2e-e88ec6475b4d None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:31.892719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd712f4-de50-468f-ba2e-e88ec6475b4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:31.893031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd712f4-de50-468f-ba2e-e88ec6475b4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:31.894496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd712f4-de50-468f-ba2e-e88ec6475b4d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:31.906140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 558/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:31.912162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:32.004263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:32.013548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7385f3-4b2a-4dab-802d-d8b524936eb6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:32.047327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259e50c-5936-4d04-aaa3-d7fa2423335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:32.047936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259e50c-5936-4d04-aaa3-d7fa2423335b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:32.048220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259e50c-5936-4d04-aaa3-d7fa2423335b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:32.048493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259e50c-5936-4d04-aaa3-d7fa2423335b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:32.049212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259e50c-5936-4d04-aaa3-d7fa2423335b None admin] RBAC: Adding query filter params (role.id=0cd23314a409488b99c3ed582dd894d9, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=589b89539f8d43e993201fab13cd443a) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:32.049539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259e50c-5936-4d04-aaa3-d7fa2423335b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:32.050960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259e50c-5936-4d04-aaa3-d7fa2423335b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:32.057462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 548/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:26:31 2022] GET /identity/v3/role_assignments?user.id=589b89539f8d43e993201fab13cd443a&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=0cd23314a409488b99c3ed582dd894d9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:33.549968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7070-bbc0-4e32-a30a-e7f522f96e99 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:33.550547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7070-bbc0-4e32-a30a-e7f522f96e99 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:33.550547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c7070-bbc0-4e32-a30a-e7f522f96e99 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:33.551862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 559/1107] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:33.557875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f923-e433-47b4-82c1-b8f698f233b6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:33.558347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f923-e433-47b4-82c1-b8f698f233b6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:33.558453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353f923-e433-47b4-82c1-b8f698f233b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:33.576476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2353f923-e433-47b4-82c1-b8f698f233b6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:33.577737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2353f923-e433-47b4-82c1-b8f698f233b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:33.648330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 549/1108] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:33.920615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c7070-bbc0-4e32-a30a-e7f522f96e99 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:34.023788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c7070-bbc0-4e32-a30a-e7f522f96e99 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:34.056656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae5f76-7358-4ac2-b0f9-e5efe980064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:34.057295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5f76-7358-4ac2-b0f9-e5efe980064a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:34.057608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5f76-7358-4ac2-b0f9-e5efe980064a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:34.057883 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae5f76-7358-4ac2-b0f9-e5efe980064a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:34.059003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae5f76-7358-4ac2-b0f9-e5efe980064a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:34.060438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae5f76-7358-4ac2-b0f9-e5efe980064a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:34.062043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 560/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:34.067836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f923-e433-47b4-82c1-b8f698f233b6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:34.150145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:34.164972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353f923-e433-47b4-82c1-b8f698f233b6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:34.198149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11ab63-4016-4859-bdba-96dcb5aefa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:34.198684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ab63-4016-4859-bdba-96dcb5aefa99 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:34.198972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ab63-4016-4859-bdba-96dcb5aefa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:34.199240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ab63-4016-4859-bdba-96dcb5aefa99 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:34.200001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11ab63-4016-4859-bdba-96dcb5aefa99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:34.201430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11ab63-4016-4859-bdba-96dcb5aefa99 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:34.222779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 550/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:26:34 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:26:36.419069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4584-dd7e-4848-a9c5-b09d93139606 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:36.419635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4584-dd7e-4848-a9c5-b09d93139606 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:36.419635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4584-dd7e-4848-a9c5-b09d93139606 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:36.420944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 561/1111] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:36.426300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460885-d17a-449b-bc59-0702bca00112 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:36.426983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460885-d17a-449b-bc59-0702bca00112 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:36.426983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460885-d17a-449b-bc59-0702bca00112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:36.445799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6b460885-d17a-449b-bc59-0702bca00112 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:36.447010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6b460885-d17a-449b-bc59-0702bca00112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:36.514938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 551/1112] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:36.784324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd4584-dd7e-4848-a9c5-b09d93139606 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:36.809082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:36.906278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd4584-dd7e-4848-a9c5-b09d93139606 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:36.943004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072e583-3f87-40ee-b3ed-02c94b8000f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:36.943548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072e583-3f87-40ee-b3ed-02c94b8000f6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:36.943831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072e583-3f87-40ee-b3ed-02c94b8000f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:36.944107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072e583-3f87-40ee-b3ed-02c94b8000f6 None admin] PATH_INFO: `/v3/roles/9d32107ec65445988af384e49812cfa7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:36.946199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072e583-3f87-40ee-b3ed-02c94b8000f6 None admin] RBAC: Authorizing `identity:get_role(role_id=9d32107ec65445988af384e49812cfa7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:36.947587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4072e583-3f87-40ee-b3ed-02c94b8000f6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:36.948948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 562/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:36 2022] GET /identity/v3/roles/9d32107ec65445988af384e49812cfa7 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:36.954855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b460885-d17a-449b-bc59-0702bca00112 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:37.023889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:37.053218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b460885-d17a-449b-bc59-0702bca00112 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:37.090582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebc44-376a-490f-9ab9-64113f1916e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:37.091238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebc44-376a-490f-9ab9-64113f1916e5 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:37.091522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebc44-376a-490f-9ab9-64113f1916e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:37.091796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ebc44-376a-490f-9ab9-64113f1916e5 None admin] PATH_INFO: `/v3/users/56b96ed6b3b5441c83298e4901c11270` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:37.106363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ebc44-376a-490f-9ab9-64113f1916e5 None admin] RBAC: Authorizing `identity:get_user(user_id=56b96ed6b3b5441c83298e4901c11270)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:37.107818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ebc44-376a-490f-9ab9-64113f1916e5 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:37.109571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 552/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:36 2022] GET /identity/v3/users/56b96ed6b3b5441c83298e4901c11270 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:37.115841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072e583-3f87-40ee-b3ed-02c94b8000f6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:37.215869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:37.226136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072e583-3f87-40ee-b3ed-02c94b8000f6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:37.273548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac29f7-8f09-438e-ba66-39637ff578a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:37.274454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac29f7-8f09-438e-ba66-39637ff578a4 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:37.274906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac29f7-8f09-438e-ba66-39637ff578a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:37.275353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac29f7-8f09-438e-ba66-39637ff578a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:37.349730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac29f7-8f09-438e-ba66-39637ff578a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:37.351227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac29f7-8f09-438e-ba66-39637ff578a4 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:37.438659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:37.449732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 563/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:26:37.455693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebc44-376a-490f-9ab9-64113f1916e5 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:37.554193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ebc44-376a-490f-9ab9-64113f1916e5 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:37.582847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:37.588847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36adc7d-a48b-450c-b240-efb7e90e8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:37.589487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36adc7d-a48b-450c-b240-efb7e90e8a85 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:37.589796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36adc7d-a48b-450c-b240-efb7e90e8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:37.590089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36adc7d-a48b-450c-b240-efb7e90e8a85 None admin] PATH_INFO: `/v3/projects/dd9b878f91ca45729fe09754ab88c1de` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:37.591182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36adc7d-a48b-450c-b240-efb7e90e8a85 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9b878f91ca45729fe09754ab88c1de)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:37.592617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36adc7d-a48b-450c-b240-efb7e90e8a85 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:37.594319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 553/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:37 2022] GET /identity/v3/projects/dd9b878f91ca45729fe09754ab88c1de => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:37.600802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac29f7-8f09-438e-ba66-39637ff578a4 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:37.704483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac29f7-8f09-438e-ba66-39637ff578a4 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:37.739027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a035f-11bf-431e-8375-d2d12245f924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:37.739627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a035f-11bf-431e-8375-d2d12245f924 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:37.739911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a035f-11bf-431e-8375-d2d12245f924 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:37.740197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a035f-11bf-431e-8375-d2d12245f924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:37.740906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a035f-11bf-431e-8375-d2d12245f924 None admin] RBAC: Adding query filter params (role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=dd9b878f91ca45729fe09754ab88c1de, user.id=56b96ed6b3b5441c83298e4901c11270) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:37.741869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a035f-11bf-431e-8375-d2d12245f924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:37.743338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a035f-11bf-431e-8375-d2d12245f924 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:37.748773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 564/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:26:37 2022] GET /identity/v3/role_assignments?user.id=56b96ed6b3b5441c83298e4901c11270&scope.project.id=dd9b878f91ca45729fe09754ab88c1de&role.id=9d32107ec65445988af384e49812cfa7 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:39.870321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b644-59cc-493d-8555-a269e4965c24 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:39.870849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b644-59cc-493d-8555-a269e4965c24 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:39.870961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b644-59cc-493d-8555-a269e4965c24 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:39.872415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 554/1118] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:39.877766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4152-6e10-442a-8572-68fa3dc098f6 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:39.878235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4152-6e10-442a-8572-68fa3dc098f6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:39.878377 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4152-6e10-442a-8572-68fa3dc098f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:39.903412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8edb4152-6e10-442a-8572-68fa3dc098f6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:39.905383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8edb4152-6e10-442a-8572-68fa3dc098f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:39.957723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:39.976397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 565/1119] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:40.252121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6b644-59cc-493d-8555-a269e4965c24 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:40.355968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6b644-59cc-493d-8555-a269e4965c24 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:40.390502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021171-d6f4-4859-a2f1-0f2498988a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:40.391133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021171-d6f4-4859-a2f1-0f2498988a54 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:40.391415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021171-d6f4-4859-a2f1-0f2498988a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:40.391691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021171-d6f4-4859-a2f1-0f2498988a54 None admin] PATH_INFO: `/v3/roles/9d32107ec65445988af384e49812cfa7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:40.393094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021171-d6f4-4859-a2f1-0f2498988a54 None admin] RBAC: Authorizing `identity:get_role(role_id=9d32107ec65445988af384e49812cfa7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:40.394490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021171-d6f4-4859-a2f1-0f2498988a54 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:40.395832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 555/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:40 2022] GET /identity/v3/roles/9d32107ec65445988af384e49812cfa7 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:40.402423 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb4152-6e10-442a-8572-68fa3dc098f6 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:40.502938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb4152-6e10-442a-8572-68fa3dc098f6 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:40.537046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd8a82-130e-47bc-ad1f-4f1971df55d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:40.538263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd8a82-130e-47bc-ad1f-4f1971df55d6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:40.538548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd8a82-130e-47bc-ad1f-4f1971df55d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:40.538825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd8a82-130e-47bc-ad1f-4f1971df55d6 None admin] PATH_INFO: `/v3/users/56b96ed6b3b5441c83298e4901c11270` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:40.539959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd8a82-130e-47bc-ad1f-4f1971df55d6 None admin] RBAC: Authorizing `identity:get_user(user_id=56b96ed6b3b5441c83298e4901c11270)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:40.541401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd8a82-130e-47bc-ad1f-4f1971df55d6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:40.543033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 566/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:40 2022] GET /identity/v3/users/56b96ed6b3b5441c83298e4901c11270 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:40.548972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021171-d6f4-4859-a2f1-0f2498988a54 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:40.616486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:40.651969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021171-d6f4-4859-a2f1-0f2498988a54 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:40.685579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb7920-ee23-48dd-b53b-c87ee3216367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:40.686218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb7920-ee23-48dd-b53b-c87ee3216367 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:40.686500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb7920-ee23-48dd-b53b-c87ee3216367 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:40.686783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb7920-ee23-48dd-b53b-c87ee3216367 None admin] PATH_INFO: `/v3/projects/dd9b878f91ca45729fe09754ab88c1de` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:40.687918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb7920-ee23-48dd-b53b-c87ee3216367 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9b878f91ca45729fe09754ab88c1de)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:40.689351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb7920-ee23-48dd-b53b-c87ee3216367 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:40.691051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 556/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:40 2022] GET /identity/v3/projects/dd9b878f91ca45729fe09754ab88c1de => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:40.697500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd8a82-130e-47bc-ad1f-4f1971df55d6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:40.752821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:40.800611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd8a82-130e-47bc-ad1f-4f1971df55d6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:40.834303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e25a7c-fef6-4945-bbe4-9c789a7a19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:40.835508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e25a7c-fef6-4945-bbe4-9c789a7a19ed None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:40.835787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e25a7c-fef6-4945-bbe4-9c789a7a19ed None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:40.836061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e25a7c-fef6-4945-bbe4-9c789a7a19ed None admin] PATH_INFO: `/v3/projects/dd9b878f91ca45729fe09754ab88c1de/users/56b96ed6b3b5441c83298e4901c11270/roles/9d32107ec65445988af384e49812cfa7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:40.838201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e25a7c-fef6-4945-bbe4-9c789a7a19ed None admin] RBAC: Authorizing `identity:create_grant(project_id=dd9b878f91ca45729fe09754ab88c1de, user_id=56b96ed6b3b5441c83298e4901c11270, role_id=9d32107ec65445988af384e49812cfa7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:40.839634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e25a7c-fef6-4945-bbe4-9c789a7a19ed None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:40.857420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 567/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:26:40 2022] PUT /identity/v3/projects/dd9b878f91ca45729fe09754ab88c1de/users/56b96ed6b3b5441c83298e4901c11270/roles/9d32107ec65445988af384e49812cfa7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:26:42.993758 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226b0e9-98f9-44dd-9aa0-1d168df8e91d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:42.994270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226b0e9-98f9-44dd-9aa0-1d168df8e91d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:42.994270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226b0e9-98f9-44dd-9aa0-1d168df8e91d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:42.995535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 557/1124] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:43.000698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad583-b092-4c91-91b8-d0f826d4ee4b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:43.001083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad583-b092-4c91-91b8-d0f826d4ee4b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:43.001261 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad583-b092-4c91-91b8-d0f826d4ee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:43.019243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2faad583-b092-4c91-91b8-d0f826d4ee4b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:43.020434 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2faad583-b092-4c91-91b8-d0f826d4ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:43.085492 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 568/1125] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:43.359330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226b0e9-98f9-44dd-9aa0-1d168df8e91d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:43.461843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226b0e9-98f9-44dd-9aa0-1d168df8e91d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:43.495555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6786f48-10b1-4fd3-9d61-0060fa779b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:43.496180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6786f48-10b1-4fd3-9d61-0060fa779b3b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:43.496463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6786f48-10b1-4fd3-9d61-0060fa779b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:43.496738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6786f48-10b1-4fd3-9d61-0060fa779b3b None admin] PATH_INFO: `/v3/roles/9d32107ec65445988af384e49812cfa7` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:43.498150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6786f48-10b1-4fd3-9d61-0060fa779b3b None admin] RBAC: Authorizing `identity:get_role(role_id=9d32107ec65445988af384e49812cfa7)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:43.499520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6786f48-10b1-4fd3-9d61-0060fa779b3b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:43.500836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 558/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:43 2022] GET /identity/v3/roles/9d32107ec65445988af384e49812cfa7 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:43.506686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faad583-b092-4c91-91b8-d0f826d4ee4b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:43.548332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:43.603939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faad583-b092-4c91-91b8-d0f826d4ee4b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:43.638622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88edf2-9e37-4e7b-9b52-167b7b6c525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:43.639247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88edf2-9e37-4e7b-9b52-167b7b6c525d None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:43.639523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88edf2-9e37-4e7b-9b52-167b7b6c525d None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:43.639793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88edf2-9e37-4e7b-9b52-167b7b6c525d None admin] PATH_INFO: `/v3/users/56b96ed6b3b5441c83298e4901c11270` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:43.640886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88edf2-9e37-4e7b-9b52-167b7b6c525d None admin] RBAC: Authorizing `identity:get_user(user_id=56b96ed6b3b5441c83298e4901c11270)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:43.642337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88edf2-9e37-4e7b-9b52-167b7b6c525d None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:43.643900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 569/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:43 2022] GET /identity/v3/users/56b96ed6b3b5441c83298e4901c11270 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:43.650217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6786f48-10b1-4fd3-9d61-0060fa779b3b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:43.653063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:43.750784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6786f48-10b1-4fd3-9d61-0060fa779b3b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:43.784466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385713e-f485-4188-a289-24ca8dcb17b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:43.785079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385713e-f485-4188-a289-24ca8dcb17b4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:43.785364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385713e-f485-4188-a289-24ca8dcb17b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:43.785687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385713e-f485-4188-a289-24ca8dcb17b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:43.851319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385713e-f485-4188-a289-24ca8dcb17b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:43.852756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385713e-f485-4188-a289-24ca8dcb17b4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:43.854555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:43.949596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 559/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:26:43.955474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88edf2-9e37-4e7b-9b52-167b7b6c525d None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:44.052994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88edf2-9e37-4e7b-9b52-167b7b6c525d None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:44.063240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:44.087913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e596ff-a675-429a-a665-433ba203c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:44.088531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e596ff-a675-429a-a665-433ba203c785 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:44.088812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e596ff-a675-429a-a665-433ba203c785 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:44.089091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e596ff-a675-429a-a665-433ba203c785 None admin] PATH_INFO: `/v3/projects/dd9b878f91ca45729fe09754ab88c1de` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:44.090209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e596ff-a675-429a-a665-433ba203c785 None admin] RBAC: Authorizing `identity:get_project(project_id=dd9b878f91ca45729fe09754ab88c1de)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:44.091638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e596ff-a675-429a-a665-433ba203c785 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:44.093264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 570/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:43 2022] GET /identity/v3/projects/dd9b878f91ca45729fe09754ab88c1de => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:44.099407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385713e-f485-4188-a289-24ca8dcb17b4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:44.195112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385713e-f485-4188-a289-24ca8dcb17b4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:44.196607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:44.229787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e952-edfe-4cbc-ab3b-b8641071f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:44.230335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e952-edfe-4cbc-ab3b-b8641071f1ae None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:44.230618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e952-edfe-4cbc-ab3b-b8641071f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:44.230894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e952-edfe-4cbc-ab3b-b8641071f1ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:44.231619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e952-edfe-4cbc-ab3b-b8641071f1ae None admin] RBAC: Adding query filter params (role.id=9d32107ec65445988af384e49812cfa7, scope.project.id=dd9b878f91ca45729fe09754ab88c1de, user.id=56b96ed6b3b5441c83298e4901c11270) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:44.231933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e952-edfe-4cbc-ab3b-b8641071f1ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:44.233347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e952-edfe-4cbc-ab3b-b8641071f1ae None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:44.239244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 560/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:26:44 2022] GET /identity/v3/role_assignments?user.id=56b96ed6b3b5441c83298e4901c11270&scope.project.id=dd9b878f91ca45729fe09754ab88c1de&role.id=9d32107ec65445988af384e49812cfa7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:46.380494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52d49-fcaf-40f4-9125-1f82232cac38 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:46.381095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52d49-fcaf-40f4-9125-1f82232cac38 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:46.381095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52d49-fcaf-40f4-9125-1f82232cac38 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:46.382411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 571/1131] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:46.387659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd2e5d-8481-4479-bc20-bcef3adadba9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:46.388105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd2e5d-8481-4479-bc20-bcef3adadba9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:46.388212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd2e5d-8481-4479-bc20-bcef3adadba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:46.406523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1efd2e5d-8481-4479-bc20-bcef3adadba9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:46.407692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1efd2e5d-8481-4479-bc20-bcef3adadba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:46.472309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 561/1132] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:46.742535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c52d49-fcaf-40f4-9125-1f82232cac38 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:46.845086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c52d49-fcaf-40f4-9125-1f82232cac38 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:46.878910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e4f9-99ef-413b-aab8-632b5c4c68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:46.879544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e4f9-99ef-413b-aab8-632b5c4c68af None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:46.879831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e4f9-99ef-413b-aab8-632b5c4c68af None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:46.880106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e4f9-99ef-413b-aab8-632b5c4c68af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:46.881769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e4f9-99ef-413b-aab8-632b5c4c68af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:46.883214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e4f9-99ef-413b-aab8-632b5c4c68af None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:46.884830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 572/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:46.890900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd2e5d-8481-4479-bc20-bcef3adadba9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:46.983389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:46.989774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd2e5d-8481-4479-bc20-bcef3adadba9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:47.023950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a5603-5850-4605-b484-ec20e75354ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:47.024559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5603-5850-4605-b484-ec20e75354ec None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:47.024842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5603-5850-4605-b484-ec20e75354ec None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:47.025118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5603-5850-4605-b484-ec20e75354ec None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:47.025810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a5603-5850-4605-b484-ec20e75354ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:47.027368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a5603-5850-4605-b484-ec20e75354ec None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:47.053857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 562/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:26:46 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:26:49.214134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae865fc1-7fcc-454d-b951-23350510e1bf None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:49.214701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae865fc1-7fcc-454d-b951-23350510e1bf None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:49.214701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae865fc1-7fcc-454d-b951-23350510e1bf None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:49.216034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 573/1135] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:49.221172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8a53-14f1-483a-9ddf-10d129e0479c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:49.221702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8a53-14f1-483a-9ddf-10d129e0479c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:49.221813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8a53-14f1-483a-9ddf-10d129e0479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:49.241062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e6ff8a53-14f1-483a-9ddf-10d129e0479c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:49.242284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e6ff8a53-14f1-483a-9ddf-10d129e0479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:49.305570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 563/1136] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:49.574809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae865fc1-7fcc-454d-b951-23350510e1bf None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:49.622870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:49.676968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae865fc1-7fcc-454d-b951-23350510e1bf None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:49.711469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b29e4a-022f-4f34-9e36-6d682bd02d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:49.712096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29e4a-022f-4f34-9e36-6d682bd02d11 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:49.712383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29e4a-022f-4f34-9e36-6d682bd02d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:49.712659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b29e4a-022f-4f34-9e36-6d682bd02d11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:49.713786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b29e4a-022f-4f34-9e36-6d682bd02d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:49.715217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b29e4a-022f-4f34-9e36-6d682bd02d11 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:49.716783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 574/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:49.722518 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff8a53-14f1-483a-9ddf-10d129e0479c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:49.798324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:49.820830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff8a53-14f1-483a-9ddf-10d129e0479c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:49.855233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbc35-af09-4e66-bc71-320a06505715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:49.855773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbc35-af09-4e66-bc71-320a06505715 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:49.856055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbc35-af09-4e66-bc71-320a06505715 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:49.856348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbc35-af09-4e66-bc71-320a06505715 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:49.856975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dbc35-af09-4e66-bc71-320a06505715 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:49.858424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dbc35-af09-4e66-bc71-320a06505715 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:49.880107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 564/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:26:49 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:26:52.063024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4200-cf9e-4c05-9252-4ef40f39a003 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:52.063496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4200-cf9e-4c05-9252-4ef40f39a003 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:52.063602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4200-cf9e-4c05-9252-4ef40f39a003 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:52.064908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 575/1139] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:52.070427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4f56d-1fb3-4b3d-8269-90aa18232e3d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:52.070829 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4f56d-1fb3-4b3d-8269-90aa18232e3d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:52.070984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4f56d-1fb3-4b3d-8269-90aa18232e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:52.088943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9ec4f56d-1fb3-4b3d-8269-90aa18232e3d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:52.090179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9ec4f56d-1fb3-4b3d-8269-90aa18232e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:52.160880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 565/1140] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:52.434604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4200-cf9e-4c05-9252-4ef40f39a003 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:52.532078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4200-cf9e-4c05-9252-4ef40f39a003 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:52.545986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:52.565620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf574-c8a2-4513-8057-9fe0e30d17c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:52.566234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf574-c8a2-4513-8057-9fe0e30d17c2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:52.566511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf574-c8a2-4513-8057-9fe0e30d17c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:52.566779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cf574-c8a2-4513-8057-9fe0e30d17c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:52.576551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cf574-c8a2-4513-8057-9fe0e30d17c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f32cf574-c8a2-4513-8057-9fe0e30d17c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:52.581190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:52.582421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:52.583845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 576/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:52.589114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4f56d-1fb3-4b3d-8269-90aa18232e3d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:52.649010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:52.696263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4f56d-1fb3-4b3d-8269-90aa18232e3d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:52.730302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:52.730922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:52.731209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:52.731483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:52.732150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:52.732457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:52.734126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:52.742301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 566/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:52.748378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf574-c8a2-4513-8057-9fe0e30d17c2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:52.848041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cf574-c8a2-4513-8057-9fe0e30d17c2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:52.882077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315a021-ac3f-4b3a-8250-ba11727764dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:52.882704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a021-ac3f-4b3a-8250-ba11727764dc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:52.882985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a021-ac3f-4b3a-8250-ba11727764dc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:52.883264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315a021-ac3f-4b3a-8250-ba11727764dc None admin] PATH_INFO: `/v3/users/222f71ae6ae44980a23d5ad749e0b3a8` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:52.897947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315a021-ac3f-4b3a-8250-ba11727764dc None admin] RBAC: Authorizing `identity:get_user(user_id=222f71ae6ae44980a23d5ad749e0b3a8)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:52.899392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315a021-ac3f-4b3a-8250-ba11727764dc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:52.901003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 577/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:52 2022] GET /identity/v3/users/222f71ae6ae44980a23d5ad749e0b3a8 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:52.906963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:53.003945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a8028-5bb7-45bb-b6ba-959ec72872de None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:53.028975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:53.038621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9749854-5324-4ac8-9ae0-d9ca4b515159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:53.039230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9749854-5324-4ac8-9ae0-d9ca4b515159 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:53.039507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9749854-5324-4ac8-9ae0-d9ca4b515159 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:53.039780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9749854-5324-4ac8-9ae0-d9ca4b515159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:53.106686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9749854-5324-4ac8-9ae0-d9ca4b515159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:53.108126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9749854-5324-4ac8-9ae0-d9ca4b515159 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:53.203993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 567/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:26:53.210050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315a021-ac3f-4b3a-8250-ba11727764dc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:53.241907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:53.309857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315a021-ac3f-4b3a-8250-ba11727764dc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:53.343599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d045e8-f4f1-4823-80c2-45ceba1e2b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:53.344225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d045e8-f4f1-4823-80c2-45ceba1e2b0c None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:53.344505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d045e8-f4f1-4823-80c2-45ceba1e2b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:53.344781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d045e8-f4f1-4823-80c2-45ceba1e2b0c None admin] PATH_INFO: `/v3/projects/b2e6384204474ba4b3ec5138bdbb1d87` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:53.345923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d045e8-f4f1-4823-80c2-45ceba1e2b0c None admin] RBAC: Authorizing `identity:get_project(project_id=b2e6384204474ba4b3ec5138bdbb1d87)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:53.347364 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d045e8-f4f1-4823-80c2-45ceba1e2b0c None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:53.349014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 578/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:53 2022] GET /identity/v3/projects/b2e6384204474ba4b3ec5138bdbb1d87 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:53.355170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9749854-5324-4ac8-9ae0-d9ca4b515159 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:53.382659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:53.453622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9749854-5324-4ac8-9ae0-d9ca4b515159 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:53.487156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b309d-1da5-4fb2-94fd-9968b07d99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:53.487751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b309d-1da5-4fb2-94fd-9968b07d99a3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:53.488033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b309d-1da5-4fb2-94fd-9968b07d99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:53.488307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b309d-1da5-4fb2-94fd-9968b07d99a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:53.489022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b309d-1da5-4fb2-94fd-9968b07d99a3 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=b2e6384204474ba4b3ec5138bdbb1d87, user.id=222f71ae6ae44980a23d5ad749e0b3a8) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:53.489333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b309d-1da5-4fb2-94fd-9968b07d99a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:53.491408 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b309d-1da5-4fb2-94fd-9968b07d99a3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:53.496640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 568/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:26:53 2022] GET /identity/v3/role_assignments?user.id=222f71ae6ae44980a23d5ad749e0b3a8&scope.project.id=b2e6384204474ba4b3ec5138bdbb1d87&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:55.645670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540cf30-05f5-475d-9fa3-263565dbf469 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:55.646240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540cf30-05f5-475d-9fa3-263565dbf469 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:55.646240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540cf30-05f5-475d-9fa3-263565dbf469 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:55.647558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 579/1147] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:55.652780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1277da-aa34-4fab-8d74-2202b89fb599 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:55.653201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1277da-aa34-4fab-8d74-2202b89fb599 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:55.653337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1277da-aa34-4fab-8d74-2202b89fb599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:55.671830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-de1277da-aa34-4fab-8d74-2202b89fb599 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:55.673016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-de1277da-aa34-4fab-8d74-2202b89fb599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:55.739972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 569/1148] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:56.007228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540cf30-05f5-475d-9fa3-263565dbf469 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:56.101574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:56.105771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540cf30-05f5-475d-9fa3-263565dbf469 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:56.139119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c7dc9-0f6c-4616-ab99-f15304b0d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:56.139740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c7dc9-0f6c-4616-ab99-f15304b0d157 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:56.140022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c7dc9-0f6c-4616-ab99-f15304b0d157 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:56.140300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c7dc9-0f6c-4616-ab99-f15304b0d157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:56.151017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c7dc9-0f6c-4616-ab99-f15304b0d157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-fc1c7dc9-0f6c-4616-ab99-f15304b0d157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:56.155792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:56.156926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:26:56.158084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 580/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:56.163620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1277da-aa34-4fab-8d74-2202b89fb599 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:56.184051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:56.259947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1277da-aa34-4fab-8d74-2202b89fb599 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:56.293160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:56.293782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:56.294068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:56.294345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:56.295003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:56.295311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:56.296667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:56.304601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 570/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:56.310443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c7dc9-0f6c-4616-ab99-f15304b0d157 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:56.413308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c7dc9-0f6c-4616-ab99-f15304b0d157 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:56.451239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf27b3-0db1-4815-b588-ac128368cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:56.451950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf27b3-0db1-4815-b588-ac128368cc59 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:56.452341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf27b3-0db1-4815-b588-ac128368cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:56.452819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf27b3-0db1-4815-b588-ac128368cc59 None admin] PATH_INFO: `/v3/users/222f71ae6ae44980a23d5ad749e0b3a8` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:56.454528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf27b3-0db1-4815-b588-ac128368cc59 None admin] RBAC: Authorizing `identity:get_user(user_id=222f71ae6ae44980a23d5ad749e0b3a8)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:56.456777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf27b3-0db1-4815-b588-ac128368cc59 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:56.458713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 581/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:56 2022] GET /identity/v3/users/222f71ae6ae44980a23d5ad749e0b3a8 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:56.465430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:56.546841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:56.564431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d542e-0b2f-42e2-90d6-03e56319e980 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:56.597435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d6403-ea89-4826-bfbd-402cb10406dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:56.598085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d6403-ea89-4826-bfbd-402cb10406dc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:56.598364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d6403-ea89-4826-bfbd-402cb10406dc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:56.598637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d6403-ea89-4826-bfbd-402cb10406dc None admin] PATH_INFO: `/v3/projects/b2e6384204474ba4b3ec5138bdbb1d87` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:56.599778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d6403-ea89-4826-bfbd-402cb10406dc None admin] RBAC: Authorizing `identity:get_project(project_id=b2e6384204474ba4b3ec5138bdbb1d87)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:56.601193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d6403-ea89-4826-bfbd-402cb10406dc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:56.602846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 571/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:56 2022] GET /identity/v3/projects/b2e6384204474ba4b3ec5138bdbb1d87 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:26:56.609111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf27b3-0db1-4815-b588-ac128368cc59 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:56.637600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:56.710807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf27b3-0db1-4815-b588-ac128368cc59 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:56.743493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343439bc-65f3-414d-8fe9-29cebcf60d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:56.744150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343439bc-65f3-414d-8fe9-29cebcf60d58 None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:56.744427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343439bc-65f3-414d-8fe9-29cebcf60d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:56.744702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343439bc-65f3-414d-8fe9-29cebcf60d58 None admin] PATH_INFO: `/v3/projects/b2e6384204474ba4b3ec5138bdbb1d87/users/222f71ae6ae44980a23d5ad749e0b3a8/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:56.746599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343439bc-65f3-414d-8fe9-29cebcf60d58 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2e6384204474ba4b3ec5138bdbb1d87, user_id=222f71ae6ae44980a23d5ad749e0b3a8, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:56.748034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343439bc-65f3-414d-8fe9-29cebcf60d58 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:56.761446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 582/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:26:56 2022] PUT /identity/v3/projects/b2e6384204474ba4b3ec5138bdbb1d87/users/222f71ae6ae44980a23d5ad749e0b3a8/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:26:58.871105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f2b1-42f2-4fd1-a16e-3b2f8cb4741e None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:58.871663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f2b1-42f2-4fd1-a16e-3b2f8cb4741e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:58.871663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f2b1-42f2-4fd1-a16e-3b2f8cb4741e None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:58.872976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 572/1154] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:26:58.878352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63968178-e855-4194-806f-d2622bf813fd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:58.878888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63968178-e855-4194-806f-d2622bf813fd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:58.879141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63968178-e855-4194-806f-d2622bf813fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:58.897223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-63968178-e855-4194-806f-d2622bf813fd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:26:58.898494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-63968178-e855-4194-806f-d2622bf813fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:26:58.963189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 583/1155] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:26:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:26:59.232744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f2b1-42f2-4fd1-a16e-3b2f8cb4741e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:59.344382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f2b1-42f2-4fd1-a16e-3b2f8cb4741e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:59.377769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321cf0f-b2dd-4a58-9741-861f785faecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:59.378401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321cf0f-b2dd-4a58-9741-861f785faecb None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:59.378684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321cf0f-b2dd-4a58-9741-861f785faecb None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:59.378962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321cf0f-b2dd-4a58-9741-861f785faecb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:59.389319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321cf0f-b2dd-4a58-9741-861f785faecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-e321cf0f-b2dd-4a58-9741-861f785faecb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:26:59.394176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:26:59.395300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:26:59.397020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 573/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:26:59.401910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63968178-e855-4194-806f-d2622bf813fd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:59.420371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:59.500015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63968178-e855-4194-806f-d2622bf813fd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:59.533312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:59.533943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:59.534225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:59.534498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:59.535152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:26:59.535456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:59.536844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:59.544666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 584/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:59.550627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321cf0f-b2dd-4a58-9741-861f785faecb None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:59.562928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:59.648909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321cf0f-b2dd-4a58-9741-861f785faecb None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:59.681021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548714-039b-4332-ac76-de43ca3c630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:59.681689 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548714-039b-4332-ac76-de43ca3c630a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:59.681943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548714-039b-4332-ac76-de43ca3c630a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:59.682216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74548714-039b-4332-ac76-de43ca3c630a None admin] PATH_INFO: `/v3/users/222f71ae6ae44980a23d5ad749e0b3a8` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:59.683310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74548714-039b-4332-ac76-de43ca3c630a None admin] RBAC: Authorizing `identity:get_user(user_id=222f71ae6ae44980a23d5ad749e0b3a8)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:59.684720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74548714-039b-4332-ac76-de43ca3c630a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:59.686318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 574/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:26:59 2022] GET /identity/v3/users/222f71ae6ae44980a23d5ad749e0b3a8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:26:59.692356 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:26:59.775084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:59.793820 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ed06-edd3-4c53-9972-3d72f5f3c899 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:26:59.827073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9374c49-e5e1-434e-a6de-13e2000606ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:26:59.827679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9374c49-e5e1-434e-a6de-13e2000606ea None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:26:59.827961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9374c49-e5e1-434e-a6de-13e2000606ea None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:26:59.828239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9374c49-e5e1-434e-a6de-13e2000606ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:26:59.895182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9374c49-e5e1-434e-a6de-13e2000606ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:26:59.896668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9374c49-e5e1-434e-a6de-13e2000606ea None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:26:59.973072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:26:59.993204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 585/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:26:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:26:59.999375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548714-039b-4332-ac76-de43ca3c630a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:00.076443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:00.097795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74548714-039b-4332-ac76-de43ca3c630a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:00.130909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9f8b8-8174-4da3-9950-a167bc64c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:00.131530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9f8b8-8174-4da3-9950-a167bc64c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:00.131807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9f8b8-8174-4da3-9950-a167bc64c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:00.132079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9f8b8-8174-4da3-9950-a167bc64c4c3 None admin] PATH_INFO: `/v3/projects/b2e6384204474ba4b3ec5138bdbb1d87` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:00.133181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9f8b8-8174-4da3-9950-a167bc64c4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=b2e6384204474ba4b3ec5138bdbb1d87)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:00.134623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9f8b8-8174-4da3-9950-a167bc64c4c3 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:00.136247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 575/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:26:59 2022] GET /identity/v3/projects/b2e6384204474ba4b3ec5138bdbb1d87 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:00.142595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9374c49-e5e1-434e-a6de-13e2000606ea None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:00.242041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9374c49-e5e1-434e-a6de-13e2000606ea None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:00.275001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcafdb-5908-4656-bf79-fd853bffc861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:00.275611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcafdb-5908-4656-bf79-fd853bffc861 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:00.275893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcafdb-5908-4656-bf79-fd853bffc861 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:00.276170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcafdb-5908-4656-bf79-fd853bffc861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:00.276884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcafdb-5908-4656-bf79-fd853bffc861 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=b2e6384204474ba4b3ec5138bdbb1d87, user.id=222f71ae6ae44980a23d5ad749e0b3a8) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:27:00.277196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcafdb-5908-4656-bf79-fd853bffc861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:00.278661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcafdb-5908-4656-bf79-fd853bffc861 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:00.284227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 586/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:27:00 2022] GET /identity/v3/role_assignments?user.id=222f71ae6ae44980a23d5ad749e0b3a8&scope.project.id=b2e6384204474ba4b3ec5138bdbb1d87&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:02.430249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee754de-7b4a-455f-b825-d585ca570ebd None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:02.430890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee754de-7b4a-455f-b825-d585ca570ebd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:02.430890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee754de-7b4a-455f-b825-d585ca570ebd None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:02.432548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 576/1162] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:27:02.438182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc96e-5bf1-4685-bed5-71af4623f3d0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:02.438651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc96e-5bf1-4685-bed5-71af4623f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:02.438765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc96e-5bf1-4685-bed5-71af4623f3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:02.457041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-20abc96e-5bf1-4685-bed5-71af4623f3d0 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:27:02.458922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-20abc96e-5bf1-4685-bed5-71af4623f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:27:02.497445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:02.524692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 587/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:27:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:27:02.791851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee754de-7b4a-455f-b825-d585ca570ebd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:02.893478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee754de-7b4a-455f-b825-d585ca570ebd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:02.926130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a990f01-7246-46ea-8c11-4456803c9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:02.926730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a990f01-7246-46ea-8c11-4456803c9037 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:02.927501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a990f01-7246-46ea-8c11-4456803c9037 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:02.927797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a990f01-7246-46ea-8c11-4456803c9037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:02.942351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:02.992823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a990f01-7246-46ea-8c11-4456803c9037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:02.994285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a990f01-7246-46ea-8c11-4456803c9037 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:03.087690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 577/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:27:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:27:03.093684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc96e-5bf1-4685-bed5-71af4623f3d0 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:03.189997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc96e-5bf1-4685-bed5-71af4623f3d0 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:03.224305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280b805-579f-4022-a8a8-01522697fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:03.224863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b805-579f-4022-a8a8-01522697fdcd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:03.225147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b805-579f-4022-a8a8-01522697fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:03.225491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b805-579f-4022-a8a8-01522697fdcd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:03.232013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280b805-579f-4022-a8a8-01522697fdcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:03.233758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280b805-579f-4022-a8a8-01522697fdcd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-3280b805-579f-4022-a8a8-01522697fdcd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:27:03.245471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:27:03.246529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:27:03.247651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 588/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:27:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:27:03.252619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a990f01-7246-46ea-8c11-4456803c9037 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:03.297865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:03.356602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a990f01-7246-46ea-8c11-4456803c9037 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:03.390468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8bb69-33ae-4fce-8ac6-6b97f5b94bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:03.391072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bb69-33ae-4fce-8ac6-6b97f5b94bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:03.391356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bb69-33ae-4fce-8ac6-6b97f5b94bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:03.391631 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bb69-33ae-4fce-8ac6-6b97f5b94bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:03.392267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8bb69-33ae-4fce-8ac6-6b97f5b94bf2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:27:03.392574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8bb69-33ae-4fce-8ac6-6b97f5b94bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:03.393969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8bb69-33ae-4fce-8ac6-6b97f5b94bf2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:03.400995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 578/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Mon Oct 3 12:27:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:05.511998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4edc4-3df0-4575-b062-fcdbe47e0d2c None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:05.512561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4edc4-3df0-4575-b062-fcdbe47e0d2c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:05.512561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4edc4-3df0-4575-b062-fcdbe47e0d2c None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:05.513911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 589/1167] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:27:05.519168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1be8-1526-49c8-aed9-f959726dafd8 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:05.519555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1be8-1526-49c8-aed9-f959726dafd8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:05.519724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1be8-1526-49c8-aed9-f959726dafd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:05.538210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e10d1be8-1526-49c8-aed9-f959726dafd8 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:27:05.539386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e10d1be8-1526-49c8-aed9-f959726dafd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:27:05.604459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 579/1168] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:27:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:27:05.902987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4edc4-3df0-4575-b062-fcdbe47e0d2c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:05.937742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:06.004334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4edc4-3df0-4575-b062-fcdbe47e0d2c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:06.037879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9ae6d-989b-4ab4-956d-c3cfa48e3382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:06.038484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ae6d-989b-4ab4-956d-c3cfa48e3382 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:06.038770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ae6d-989b-4ab4-956d-c3cfa48e3382 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:06.039049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ae6d-989b-4ab4-956d-c3cfa48e3382 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:06.039722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9ae6d-989b-4ab4-956d-c3cfa48e3382 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:06.041083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9ae6d-989b-4ab4-956d-c3cfa48e3382 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:06.057488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 590/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Mon Oct 3 12:27:05 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:27:08.204087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756187-f201-47fd-bbe4-c035516083f8 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:08.204641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756187-f201-47fd-bbe4-c035516083f8 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:08.204641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a756187-f201-47fd-bbe4-c035516083f8 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:08.206028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 580/1170] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:27:08.211357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9f54-4588-4dc9-a96c-46f421201ad1 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:08.211745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9f54-4588-4dc9-a96c-46f421201ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:08.211913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9f54-4588-4dc9-a96c-46f421201ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:08.229960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-48be9f54-4588-4dc9-a96c-46f421201ad1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:27:08.231161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-48be9f54-4588-4dc9-a96c-46f421201ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:27:08.296750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 591/1171] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:27:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:27:08.569856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a756187-f201-47fd-bbe4-c035516083f8 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:08.612057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:08.670111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a756187-f201-47fd-bbe4-c035516083f8 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:08.706139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae141a-3e1c-4fec-aaa9-98b2650ce530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:08.706772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae141a-3e1c-4fec-aaa9-98b2650ce530 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:08.707051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae141a-3e1c-4fec-aaa9-98b2650ce530 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:08.707324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae141a-3e1c-4fec-aaa9-98b2650ce530 None admin] PATH_INFO: `/v3/domains/a75e7c088232491cb45c50bf23e96fb2` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:08.718530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae141a-3e1c-4fec-aaa9-98b2650ce530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a75e7c088232491cb45c50bf23e96fb2)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:08.719997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae141a-3e1c-4fec-aaa9-98b2650ce530 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:08.721688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 581/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Mon Oct 3 12:27:08 2022] GET /identity/v3/domains/a75e7c088232491cb45c50bf23e96fb2 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:08.728046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be9f54-4588-4dc9-a96c-46f421201ad1 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:08.752611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:08.825323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be9f54-4588-4dc9-a96c-46f421201ad1 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:08.859493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20fe68-7535-4cfd-acd6-855ad955ec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:08.860099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20fe68-7535-4cfd-acd6-855ad955ec81 None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:08.860381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20fe68-7535-4cfd-acd6-855ad955ec81 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:08.860653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20fe68-7535-4cfd-acd6-855ad955ec81 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:08.861305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20fe68-7535-4cfd-acd6-855ad955ec81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:08.862787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20fe68-7535-4cfd-acd6-855ad955ec81 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:08.889601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 592/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:27:08 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:27:11.100563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca492b2-413e-49c4-92d4-d2e70cad756d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:11.101091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca492b2-413e-49c4-92d4-d2e70cad756d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:11.101091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca492b2-413e-49c4-92d4-d2e70cad756d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:11.102389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 582/1174] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:27:11.107899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4047d-8a2a-4264-a7d3-7899c21ec941 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:11.108277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4047d-8a2a-4264-a7d3-7899c21ec941 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:11.108453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4047d-8a2a-4264-a7d3-7899c21ec941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:11.126299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5ec4047d-8a2a-4264-a7d3-7899c21ec941 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:27:11.127484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5ec4047d-8a2a-4264-a7d3-7899c21ec941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:27:11.192406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 593/1175] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:27:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:27:11.463703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca492b2-413e-49c4-92d4-d2e70cad756d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:11.559777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:11.563807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca492b2-413e-49c4-92d4-d2e70cad756d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:11.597338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e9455-5e83-4aef-9091-43d65ca144d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:11.598024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9455-5e83-4aef-9091-43d65ca144d8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:11.598310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9455-5e83-4aef-9091-43d65ca144d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:11.598588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e9455-5e83-4aef-9091-43d65ca144d8 None admin] PATH_INFO: `/v3/domains/a75e7c088232491cb45c50bf23e96fb2` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:11.599704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e9455-5e83-4aef-9091-43d65ca144d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a75e7c088232491cb45c50bf23e96fb2)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:11.601128 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e9455-5e83-4aef-9091-43d65ca144d8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:11.602730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 583/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Mon Oct 3 12:27:11 2022] GET /identity/v3/domains/a75e7c088232491cb45c50bf23e96fb2 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:11.608758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4047d-8a2a-4264-a7d3-7899c21ec941 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:11.616889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:11.709152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4047d-8a2a-4264-a7d3-7899c21ec941 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:11.746847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e03f40-f9f2-443e-8b39-4fe283fb136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:11.747667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03f40-f9f2-443e-8b39-4fe283fb136a None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:11.748093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03f40-f9f2-443e-8b39-4fe283fb136a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:11.748510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03f40-f9f2-443e-8b39-4fe283fb136a None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:11.749554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03f40-f9f2-443e-8b39-4fe283fb136a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:11.751835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03f40-f9f2-443e-8b39-4fe283fb136a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:11.784389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 594/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:27:11 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:27:13.985404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52e59-927b-4daa-b9ff-c2ce856109bd None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:13.985968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52e59-927b-4daa-b9ff-c2ce856109bd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:13.985968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52e59-927b-4daa-b9ff-c2ce856109bd None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:13.987228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 584/1178] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:27:13.993234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ac3f-319c-4fd4-8718-3539caaa632c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:13.993716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ac3f-319c-4fd4-8718-3539caaa632c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:13.993812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187ac3f-319c-4fd4-8718-3539caaa632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:14.011629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-0187ac3f-319c-4fd4-8718-3539caaa632c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:27:14.012816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0187ac3f-319c-4fd4-8718-3539caaa632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:27:14.068031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:14.079468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 595/1179] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:27:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:27:14.346642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce52e59-927b-4daa-b9ff-c2ce856109bd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:14.446710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce52e59-927b-4daa-b9ff-c2ce856109bd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:14.479623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a1446-287c-45f9-a2ab-870f33fa701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:14.480244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a1446-287c-45f9-a2ab-870f33fa701d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:14.480524 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a1446-287c-45f9-a2ab-870f33fa701d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:14.480799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a1446-287c-45f9-a2ab-870f33fa701d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:14.491789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a1446-287c-45f9-a2ab-870f33fa701d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-438a1446-287c-45f9-a2ab-870f33fa701d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:27:14.496541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:27:14.497669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:27:14.498725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 585/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:27:14.503697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ac3f-319c-4fd4-8718-3539caaa632c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:14.599025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187ac3f-319c-4fd4-8718-3539caaa632c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:14.632188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:14.632788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:14.633071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:14.633347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:14.634040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:27:14.634345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:14.635718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:14.643496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 596/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:14.649364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a1446-287c-45f9-a2ab-870f33fa701d None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:14.677697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:14.747138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a1446-287c-45f9-a2ab-870f33fa701d None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:14.779928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cdf3d-79bb-4a77-aa8c-a97f559356e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:14.780563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cdf3d-79bb-4a77-aa8c-a97f559356e4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:14.780846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cdf3d-79bb-4a77-aa8c-a97f559356e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:14.781121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cdf3d-79bb-4a77-aa8c-a97f559356e4 None admin] PATH_INFO: `/v3/users/eda258cfacbf47fca17a2c8ff979a2c6` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:14.794897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cdf3d-79bb-4a77-aa8c-a97f559356e4 None admin] RBAC: Authorizing `identity:get_user(user_id=eda258cfacbf47fca17a2c8ff979a2c6)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:14.796339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cdf3d-79bb-4a77-aa8c-a97f559356e4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:14.798012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 586/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:27:14 2022] GET /identity/v3/users/eda258cfacbf47fca17a2c8ff979a2c6 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:14.804407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:14.859032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:14.904162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ef2d-5879-476b-b061-2ba7cdae8f81 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:14.936696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d9fce-883a-4041-87e6-2b264ea7ed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:14.937293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d9fce-883a-4041-87e6-2b264ea7ed65 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:14.937600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d9fce-883a-4041-87e6-2b264ea7ed65 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:14.937878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d9fce-883a-4041-87e6-2b264ea7ed65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:15.003406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d9fce-883a-4041-87e6-2b264ea7ed65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:15.004855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d9fce-883a-4041-87e6-2b264ea7ed65 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:15.056710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:15.102495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 597/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:27:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:27:15.109013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cdf3d-79bb-4a77-aa8c-a97f559356e4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:15.190025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:15.205364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cdf3d-79bb-4a77-aa8c-a97f559356e4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:15.238341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620123ee-a9f8-4cc7-84d1-1c1073040ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:15.238953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620123ee-a9f8-4cc7-84d1-1c1073040ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:15.239231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620123ee-a9f8-4cc7-84d1-1c1073040ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:15.239504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620123ee-a9f8-4cc7-84d1-1c1073040ce7 None admin] PATH_INFO: `/v3/projects/422c17be7f014ae5af4bd4b8d887585c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:15.240600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620123ee-a9f8-4cc7-84d1-1c1073040ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=422c17be7f014ae5af4bd4b8d887585c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:15.242050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620123ee-a9f8-4cc7-84d1-1c1073040ce7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:15.243650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 587/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:27:15 2022] GET /identity/v3/projects/422c17be7f014ae5af4bd4b8d887585c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:15.250196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d9fce-883a-4041-87e6-2b264ea7ed65 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:15.347627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d9fce-883a-4041-87e6-2b264ea7ed65 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:15.388097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96096c8b-d938-42c0-bc89-e0152f2eadff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:15.388700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096c8b-d938-42c0-bc89-e0152f2eadff None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:15.388983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096c8b-d938-42c0-bc89-e0152f2eadff None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:15.389260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096c8b-d938-42c0-bc89-e0152f2eadff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:15.390002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096c8b-d938-42c0-bc89-e0152f2eadff None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=422c17be7f014ae5af4bd4b8d887585c, user.id=eda258cfacbf47fca17a2c8ff979a2c6) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:27:15.390329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096c8b-d938-42c0-bc89-e0152f2eadff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:15.391752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096c8b-d938-42c0-bc89-e0152f2eadff None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:15.397629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 598/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:27:15 2022] GET /identity/v3/role_assignments?user.id=eda258cfacbf47fca17a2c8ff979a2c6&scope.project.id=422c17be7f014ae5af4bd4b8d887585c&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:17.588591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912230c-de60-4844-92cc-392f1d6cc066 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:17.589188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912230c-de60-4844-92cc-392f1d6cc066 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:17.589188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912230c-de60-4844-92cc-392f1d6cc066 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:17.590484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 588/1186] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:27:17.595772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad45fe7-6c89-4257-93b2-6195a65ff5a8 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:17.596239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad45fe7-6c89-4257-93b2-6195a65ff5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:17.596349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad45fe7-6c89-4257-93b2-6195a65ff5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:17.615742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-bad45fe7-6c89-4257-93b2-6195a65ff5a8 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:27:17.616944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-bad45fe7-6c89-4257-93b2-6195a65ff5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:27:17.631081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:17.683332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 599/1187] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:27:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:27:17.966879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912230c-de60-4844-92cc-392f1d6cc066 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:18.065805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912230c-de60-4844-92cc-392f1d6cc066 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:18.099024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc524ea8-11f9-4777-bc53-4fbf7ed1e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:18.099652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc524ea8-11f9-4777-bc53-4fbf7ed1e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:18.099935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc524ea8-11f9-4777-bc53-4fbf7ed1e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:18.100211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc524ea8-11f9-4777-bc53-4fbf7ed1e7c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:18.110360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc524ea8-11f9-4777-bc53-4fbf7ed1e7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-fc524ea8-11f9-4777-bc53-4fbf7ed1e7c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:27:18.115642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:27:18.116824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:27:18.117974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 589/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:27:18.122840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad45fe7-6c89-4257-93b2-6195a65ff5a8 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:18.219726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad45fe7-6c89-4257-93b2-6195a65ff5a8 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:18.254250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:18.255042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:18.255344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:18.255606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:18.256266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:27:18.256573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:18.257995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:18.265921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 600/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:18.273455 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc524ea8-11f9-4777-bc53-4fbf7ed1e7c6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:18.289072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:18.371371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc524ea8-11f9-4777-bc53-4fbf7ed1e7c6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:18.403756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25247c91-2c37-46b0-8325-68270815cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:18.404375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25247c91-2c37-46b0-8325-68270815cf69 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:18.404654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25247c91-2c37-46b0-8325-68270815cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:18.404928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25247c91-2c37-46b0-8325-68270815cf69 None admin] PATH_INFO: `/v3/users/eda258cfacbf47fca17a2c8ff979a2c6` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:18.406050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25247c91-2c37-46b0-8325-68270815cf69 None admin] RBAC: Authorizing `identity:get_user(user_id=eda258cfacbf47fca17a2c8ff979a2c6)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:18.407463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25247c91-2c37-46b0-8325-68270815cf69 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:18.409022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 590/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:27:18 2022] GET /identity/v3/users/eda258cfacbf47fca17a2c8ff979a2c6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:18.415399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:18.428570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:18.514552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab0b67-4d9d-4376-82a0-caa89e47907a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:18.547586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299fba7-058b-486c-b5c4-2d363499a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:18.548203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299fba7-058b-486c-b5c4-2d363499a822 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:18.548481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299fba7-058b-486c-b5c4-2d363499a822 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:18.548753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299fba7-058b-486c-b5c4-2d363499a822 None admin] PATH_INFO: `/v3/projects/422c17be7f014ae5af4bd4b8d887585c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:18.549874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299fba7-058b-486c-b5c4-2d363499a822 None admin] RBAC: Authorizing `identity:get_project(project_id=422c17be7f014ae5af4bd4b8d887585c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:18.551351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299fba7-058b-486c-b5c4-2d363499a822 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:18.552951 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 601/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:27:18 2022] GET /identity/v3/projects/422c17be7f014ae5af4bd4b8d887585c => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:18.559109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25247c91-2c37-46b0-8325-68270815cf69 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:18.638488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:18.657048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25247c91-2c37-46b0-8325-68270815cf69 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:18.690074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ecb53-79f4-4339-b582-aa8f429a37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:18.690745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ecb53-79f4-4339-b582-aa8f429a37ed None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:18.691028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ecb53-79f4-4339-b582-aa8f429a37ed None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:18.691308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ecb53-79f4-4339-b582-aa8f429a37ed None admin] PATH_INFO: `/v3/projects/422c17be7f014ae5af4bd4b8d887585c/users/eda258cfacbf47fca17a2c8ff979a2c6/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:18.693341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ecb53-79f4-4339-b582-aa8f429a37ed None admin] RBAC: Authorizing `identity:create_grant(project_id=422c17be7f014ae5af4bd4b8d887585c, user_id=eda258cfacbf47fca17a2c8ff979a2c6, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:18.694803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ecb53-79f4-4339-b582-aa8f429a37ed None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:18.708182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 591/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:27:18 2022] PUT /identity/v3/projects/422c17be7f014ae5af4bd4b8d887585c/users/eda258cfacbf47fca17a2c8ff979a2c6/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:27:20.969225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fc09-7dee-42e2-8717-3a17b5c13b03 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:20.969769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fc09-7dee-42e2-8717-3a17b5c13b03 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:20.969769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fc09-7dee-42e2-8717-3a17b5c13b03 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:20.971070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 602/1193] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:27:20.976724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a71a-29a7-4414-89f8-2257a7dda0ca None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:20.977168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a71a-29a7-4414-89f8-2257a7dda0ca None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:20.977436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a71a-29a7-4414-89f8-2257a7dda0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:20.997760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6775a71a-29a7-4414-89f8-2257a7dda0ca None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:27:20.998865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6775a71a-29a7-4414-89f8-2257a7dda0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:27:21.071642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 592/1194] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:27:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:27:21.351782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01fc09-7dee-42e2-8717-3a17b5c13b03 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:21.443072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:21.469592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01fc09-7dee-42e2-8717-3a17b5c13b03 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:21.507500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2a5a9-f18b-4d94-b93d-d4087245f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:21.508147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a5a9-f18b-4d94-b93d-d4087245f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:21.508434 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a5a9-f18b-4d94-b93d-d4087245f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:21.508711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a5a9-f18b-4d94-b93d-d4087245f5a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:21.518868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2a5a9-f18b-4d94-b93d-d4087245f5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-75b2a5a9-f18b-4d94-b93d-d4087245f5a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:27:21.524142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:27:21.525304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:27:21.526421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 603/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:27:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:27:21.531658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a71a-29a7-4414-89f8-2257a7dda0ca None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:21.600017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:21.630184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a71a-29a7-4414-89f8-2257a7dda0ca None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:21.664070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:21.664644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:21.664922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:21.665197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:21.665888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:27:21.666196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:21.667556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:21.676902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 593/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:21.683560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2a5a9-f18b-4d94-b93d-d4087245f5a2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:21.800388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2a5a9-f18b-4d94-b93d-d4087245f5a2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:21.835610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c9f89-bc49-4d25-97f6-248a1e510bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:21.836240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c9f89-bc49-4d25-97f6-248a1e510bdf None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:21.836522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c9f89-bc49-4d25-97f6-248a1e510bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:21.836798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c9f89-bc49-4d25-97f6-248a1e510bdf None admin] PATH_INFO: `/v3/users/eda258cfacbf47fca17a2c8ff979a2c6` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:21.837940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c9f89-bc49-4d25-97f6-248a1e510bdf None admin] RBAC: Authorizing `identity:get_user(user_id=eda258cfacbf47fca17a2c8ff979a2c6)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:21.839373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c9f89-bc49-4d25-97f6-248a1e510bdf None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:21.841024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 604/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Mon Oct 3 12:27:21 2022] GET /identity/v3/users/eda258cfacbf47fca17a2c8ff979a2c6 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:21.846832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:21.944495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be02a2-7b24-4b9e-9a98-c06366eac8db None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:21.976392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6acf-39fe-420a-97c3-f156bd724aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:21.976986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6acf-39fe-420a-97c3-f156bd724aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:21.977575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6acf-39fe-420a-97c3-f156bd724aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:21.977575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6acf-39fe-420a-97c3-f156bd724aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:21.980020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:22.044200 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6acf-39fe-420a-97c3-f156bd724aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:22.045672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6acf-39fe-420a-97c3-f156bd724aa4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:22.141348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 594/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:27:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:27:22.147927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c9f89-bc49-4d25-97f6-248a1e510bdf None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:22.156791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:22.246000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c9f89-bc49-4d25-97f6-248a1e510bdf None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:22.278672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ffc55-292d-45b2-aace-3ba612ff7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:22.279279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ffc55-292d-45b2-aace-3ba612ff7b59 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:22.279555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ffc55-292d-45b2-aace-3ba612ff7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:22.279822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ffc55-292d-45b2-aace-3ba612ff7b59 None admin] PATH_INFO: `/v3/projects/422c17be7f014ae5af4bd4b8d887585c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:22.280910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ffc55-292d-45b2-aace-3ba612ff7b59 None admin] RBAC: Authorizing `identity:get_project(project_id=422c17be7f014ae5af4bd4b8d887585c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:22.282371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ffc55-292d-45b2-aace-3ba612ff7b59 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:22.283974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 605/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Mon Oct 3 12:27:22 2022] GET /identity/v3/projects/422c17be7f014ae5af4bd4b8d887585c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:22.290140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6acf-39fe-420a-97c3-f156bd724aa4 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:27:22.323334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:22.388108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6acf-39fe-420a-97c3-f156bd724aa4 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:27:22.420445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013878de-7ab8-440f-9104-00782bab1ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:27:22.421043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013878de-7ab8-440f-9104-00782bab1ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:27:22.421328 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013878de-7ab8-440f-9104-00782bab1ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:27:22.421635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013878de-7ab8-440f-9104-00782bab1ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:27:22.422360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013878de-7ab8-440f-9104-00782bab1ed9 None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=422c17be7f014ae5af4bd4b8d887585c, user.id=eda258cfacbf47fca17a2c8ff979a2c6) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:27:22.422674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013878de-7ab8-440f-9104-00782bab1ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:27:22.424112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013878de-7ab8-440f-9104-00782bab1ed9 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:27:22.430678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 595/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:27:22 2022] GET /identity/v3/role_assignments?user.id=eda258cfacbf47fca17a2c8ff979a2c6&scope.project.id=422c17be7f014ae5af4bd4b8d887585c&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:27:32.274555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=63 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:27:32.427772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=51 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:18.523812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1127f-8630-4caa-8f4c-1e5d4d433a67 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:18.524550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1127f-8630-4caa-8f4c-1e5d4d433a67 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:18.524550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1127f-8630-4caa-8f4c-1e5d4d433a67 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:18.526114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 606/1201] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:18.532491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3ebd-3aae-4458-9af7-abf53a9876c4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:18.533152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3ebd-3aae-4458-9af7-abf53a9876c4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:18.533152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3ebd-3aae-4458-9af7-abf53a9876c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:18.553164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b25a3ebd-3aae-4458-9af7-abf53a9876c4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:18.556699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b25a3ebd-3aae-4458-9af7-abf53a9876c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:18.647132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 596/1202] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:18.921892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1127f-8630-4caa-8f4c-1e5d4d433a67 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:19.057004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1127f-8630-4caa-8f4c-1e5d4d433a67 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:19.099244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:19.100213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:19.100688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:19.101156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:19.113552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:19.114743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:19.131702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:19.133726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:19.135029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:19.135029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:19.135029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:19.135029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 607/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:19.140276 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3ebd-3aae-4458-9af7-abf53a9876c4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:19.268052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3ebd-3aae-4458-9af7-abf53a9876c4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:19.306877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:19.315428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded7e79-158a-47d4-941b-8a8fbbf9d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:19.316063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7e79-158a-47d4-941b-8a8fbbf9d760 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:19.316350 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7e79-158a-47d4-941b-8a8fbbf9d760 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:19.316629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7e79-158a-47d4-941b-8a8fbbf9d760 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:19.317291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded7e79-158a-47d4-941b-8a8fbbf9d760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:19.317628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded7e79-158a-47d4-941b-8a8fbbf9d760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:19.319104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded7e79-158a-47d4-941b-8a8fbbf9d760 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:19.335911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 597/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:28:19.341472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:19.412807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:19.481927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8ec4f-a123-43e4-aeb8-9019887d3e31 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:19.521637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5357efa-7962-4698-879e-901b440f237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:19.521637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357efa-7962-4698-879e-901b440f237b None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:19.521637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357efa-7962-4698-879e-901b440f237b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:19.522656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5357efa-7962-4698-879e-901b440f237b None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:19.522656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5357efa-7962-4698-879e-901b440f237b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:19.524140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5357efa-7962-4698-879e-901b440f237b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:19.561544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 608/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Mon Oct 3 12:28:19 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:28:21.855573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0836c41-4801-4a9f-92a0-37b5fadb8955 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:21.856444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0836c41-4801-4a9f-92a0-37b5fadb8955 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:21.856444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0836c41-4801-4a9f-92a0-37b5fadb8955 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:21.858059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 598/1206] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:21.863842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62100c8f-bfbe-40d9-bf1d-4b1dfb5da99a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:21.864581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62100c8f-bfbe-40d9-bf1d-4b1dfb5da99a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:21.864581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62100c8f-bfbe-40d9-bf1d-4b1dfb5da99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:21.884010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-62100c8f-bfbe-40d9-bf1d-4b1dfb5da99a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:21.885229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-62100c8f-bfbe-40d9-bf1d-4b1dfb5da99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:21.968490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 609/1207] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:22.271109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0836c41-4801-4a9f-92a0-37b5fadb8955 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:22.403094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0836c41-4801-4a9f-92a0-37b5fadb8955 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:22.443142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38545d4-4579-451a-972e-14f12ccda7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:22.443791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38545d4-4579-451a-972e-14f12ccda7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:22.444163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38545d4-4579-451a-972e-14f12ccda7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:22.444347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38545d4-4579-451a-972e-14f12ccda7b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:22.456633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38545d4-4579-451a-972e-14f12ccda7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a38545d4-4579-451a-972e-14f12ccda7b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:28:22.461612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:22.462582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:22.463482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 599/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:28:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:22.469822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62100c8f-bfbe-40d9-bf1d-4b1dfb5da99a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:22.514227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:22.588546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62100c8f-bfbe-40d9-bf1d-4b1dfb5da99a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:22.630918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:22.631918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:22.632427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:22.632908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:22.633925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:22.634189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:22.635532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:22.645015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 610/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:28:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:22.652458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38545d4-4579-451a-972e-14f12ccda7b1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:22.728018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:22.790345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38545d4-4579-451a-972e-14f12ccda7b1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:22.829443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:22.830166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:22.830465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:22.830858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:22.842910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:22.844858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:22.861335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:22.863199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:22.864349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:22.864349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:22.864349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:22.864349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 600/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:28:22.868909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:22.986387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:22.989502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d753e-750c-46e6-8a53-9b2f95f96e50 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:23.030213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:23.030901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:23.031224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:23.031504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:23.032231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:23.032530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:23.034045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:23.052127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 611/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:28:23.053414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:23.168239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def95a07-5ab4-4eaf-8a9a-7d629f08a104 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:23.170604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:23.212976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:23.213880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:23.214158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:23.214432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:23.223263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:23.224799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:28:23.238848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:23.240291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:23.241653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 601/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:23.246915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:23.363902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07384c63-4ba2-4b33-b4c8-4101f8b24705 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:23.404518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:23.405282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:23.405732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:23.406098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:23.406930 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:23.407378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:23.409018 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:23.429633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 612/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Oct 3 12:28:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:23.433333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:23.556014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950a68-8324-4fde-851f-d4c1c417e79a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:23.595840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e4d28-2125-47f3-bf94-1db84a41d858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:23.596484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4d28-2125-47f3-bf94-1db84a41d858 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:23.596898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4d28-2125-47f3-bf94-1db84a41d858 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:23.597185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e4d28-2125-47f3-bf94-1db84a41d858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:23.640758 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:23.689934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e4d28-2125-47f3-bf94-1db84a41d858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:23.689934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e4d28-2125-47f3-bf94-1db84a41d858 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:23.806115 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 602/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:28:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:28:23.807367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:23.829507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:23.917535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d0b6-28f8-42b8-bb93-4413c375055b None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:23.955450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:23.956015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:23.956295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:23.956568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:23.968905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:23.970684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:23.987349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:23.988453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:23.989359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:23.989359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:23.989359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:23.989359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 613/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:23.996326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e4d28-2125-47f3-bf94-1db84a41d858 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:24.071645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:24.122231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e4d28-2125-47f3-bf94-1db84a41d858 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:24.158884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:24.159508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:24.159791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:24.160069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:24.160712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:24.161019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:24.162478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:24.174505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 603/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:24.180641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:24.266694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:24.299273 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3454bb63-9440-4c49-aae9-0d687df820a4 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:24.336220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:24.336844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:24.337162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:24.337435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:24.344679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:24.346173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:28:24.358797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:24.359847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:24.360778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 614/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:24.365797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:24.497062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d2504-15e6-42d2-8907-c105bb63a890 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:24.523000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:24.536894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b664-a32e-4b5a-88eb-24fdd9f25aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:24.537508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b664-a32e-4b5a-88eb-24fdd9f25aff None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:24.537813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b664-a32e-4b5a-88eb-24fdd9f25aff None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:24.538104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b664-a32e-4b5a-88eb-24fdd9f25aff None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:24.538785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b664-a32e-4b5a-88eb-24fdd9f25aff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:24.539097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b664-a32e-4b5a-88eb-24fdd9f25aff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:24.540575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b664-a32e-4b5a-88eb-24fdd9f25aff None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:24.556295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 604/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:24.562652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:24.709846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53f90d-4d07-4c7e-82db-5c83d54fe5ff None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:24.748540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:24.755896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89545cb-6c57-4835-b3bc-d2c50fceed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:24.756938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89545cb-6c57-4835-b3bc-d2c50fceed66 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:24.757988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89545cb-6c57-4835-b3bc-d2c50fceed66 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:24.757988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89545cb-6c57-4835-b3bc-d2c50fceed66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:24.758791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89545cb-6c57-4835-b3bc-d2c50fceed66 None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=d0886bba187b4d608cea7dcffed2c2b5) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:24.759134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89545cb-6c57-4835-b3bc-d2c50fceed66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:24.761017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89545cb-6c57-4835-b3bc-d2c50fceed66 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:24.768416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 615/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:28:24 2022] GET /identity/v3/role_assignments?user.id=d0886bba187b4d608cea7dcffed2c2b5&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:26.961786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1443c77-c56a-435b-afb4-fa92dee93e8d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:26.962339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1443c77-c56a-435b-afb4-fa92dee93e8d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:26.962339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1443c77-c56a-435b-afb4-fa92dee93e8d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:26.963587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 605/1220] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:28:26.969070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e8ba3-a66b-4f74-b0f1-31e90e90c82f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:26.969545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e8ba3-a66b-4f74-b0f1-31e90e90c82f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:26.969638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e8ba3-a66b-4f74-b0f1-31e90e90c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:26.989346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-636e8ba3-a66b-4f74-b0f1-31e90e90c82f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:26.990606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-636e8ba3-a66b-4f74-b0f1-31e90e90c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:27.062564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 616/1221] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:27.339829 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1443c77-c56a-435b-afb4-fa92dee93e8d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:27.452542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1443c77-c56a-435b-afb4-fa92dee93e8d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:27.495387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867fc26-6ef2-459c-8280-323a7814f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:27.496243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867fc26-6ef2-459c-8280-323a7814f975 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:27.496679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867fc26-6ef2-459c-8280-323a7814f975 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:27.497081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867fc26-6ef2-459c-8280-323a7814f975 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:27.512126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867fc26-6ef2-459c-8280-323a7814f975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-7867fc26-6ef2-459c-8280-323a7814f975 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:28:27.519449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:27.521479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:27.523382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 606/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:27.530529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e8ba3-a66b-4f74-b0f1-31e90e90c82f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:27.647296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e8ba3-a66b-4f74-b0f1-31e90e90c82f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:27.672671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:27.684934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:27.685622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:27.685905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:27.686264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:27.687164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:27.687491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:27.689264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:27.701751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 617/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:28:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:28:27.706127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867fc26-6ef2-459c-8280-323a7814f975 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:27.766048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:27.834692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867fc26-6ef2-459c-8280-323a7814f975 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:27.875761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:27.876400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:27.876701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:27.876947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:27.888948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:27.890422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:27.905774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:27.906945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:27.912519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:27.912519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:27.912519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:27.912519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 607/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:27.913638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:28.030310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b375935-8b42-456a-92d3-136a6903e5b4 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:28.079210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:28.079956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:28.080272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:28.080553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:28.081302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:28.081658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:28.083096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:28.101548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 618/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:28.104309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:28.212934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:28.221254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253133e-8cfc-454f-8de9-1ffed88fe542 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:28.261282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:28.261984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:28.262456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:28.263253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:28.272783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:28.274634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:28:28.287363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:28.288597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:28.289919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 608/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:28.295397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:28.347781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:28.406828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f80bd-5a74-4926-aa29-0d6627bbfa44 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:28.453006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:28.453786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:28.454188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:28.454413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:28.455255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:28.455591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:28.457112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:28.476813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 619/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Oct 3 12:28:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:28.483746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:28.594960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e80b7a-519d-44ce-9fc6-5a05e5e367f8 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:28.638743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:28.639453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:28.639735 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:28.640008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:28.652116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:28.654259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:28.671479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:28.672660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:28.673759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:28.673759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:28.673759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:28.673759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 609/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:28.678732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:28.803890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedb3fd-ef10-4d2a-86bf-2c0fcebad5ef None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:28.807094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:28.844736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:28.845345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:28.845664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:28.845984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:28.846859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:28.847237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:28.848696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:28.862342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 620/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:28.868723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:28.879267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:28.976682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbfa24-0c06-40c3-ac98-d9089c31e071 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:29.014133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:29.014833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:29.015068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:29.015392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:29.023395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:29.024836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:28:29.038748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:29.040194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:29.041730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 610/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:29.046553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:29.155522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9527d-6b17-4682-a8d3-bf8666975777 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:29.194750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694e0a8-99a5-4368-9718-e5b1753195cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:29.195362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e0a8-99a5-4368-9718-e5b1753195cb None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:29.195645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e0a8-99a5-4368-9718-e5b1753195cb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:29.195924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694e0a8-99a5-4368-9718-e5b1753195cb None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:29.196616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694e0a8-99a5-4368-9718-e5b1753195cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:29.196929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694e0a8-99a5-4368-9718-e5b1753195cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:29.198398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694e0a8-99a5-4368-9718-e5b1753195cb None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:29.211893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 621/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:29.218987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:29.299680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:29.340201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca216b46-4abf-4cbc-b621-7f703520719f None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:29.375950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76054745-dbb8-45c7-901b-652d7d6244ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:29.376787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054745-dbb8-45c7-901b-652d7d6244ef None admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:29.377161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054745-dbb8-45c7-901b-652d7d6244ef None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:29.377543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054745-dbb8-45c7-901b-652d7d6244ef None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/d0886bba187b4d608cea7dcffed2c2b5/roles/8620609e2f8a4b039384fd7a3d24253d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:29.392441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76054745-dbb8-45c7-901b-652d7d6244ef None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=d0886bba187b4d608cea7dcffed2c2b5, role_id=8620609e2f8a4b039384fd7a3d24253d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:29.393897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76054745-dbb8-45c7-901b-652d7d6244ef None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:29.408542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 611/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:28:29 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/d0886bba187b4d608cea7dcffed2c2b5/roles/8620609e2f8a4b039384fd7a3d24253d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:28:31.647710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ce7b-b158-483c-9bee-b58b953005a9 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:31.648292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ce7b-b158-483c-9bee-b58b953005a9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:31.648292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223ce7b-b158-483c-9bee-b58b953005a9 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:31.649599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 622/1233] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:28:31.656164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327277e-c10c-45e9-ac55-65c90fbe7f55 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:31.656855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327277e-c10c-45e9-ac55-65c90fbe7f55 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:31.657113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327277e-c10c-45e9-ac55-65c90fbe7f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:31.678342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3327277e-c10c-45e9-ac55-65c90fbe7f55 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:31.679575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3327277e-c10c-45e9-ac55-65c90fbe7f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:31.761549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 612/1234] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:32.049916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ce7b-b158-483c-9bee-b58b953005a9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:32.077096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:32.166529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223ce7b-b158-483c-9bee-b58b953005a9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:32.209219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb49f8-760f-44d6-a941-b5fd1f200786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:32.209918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb49f8-760f-44d6-a941-b5fd1f200786 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:32.210201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb49f8-760f-44d6-a941-b5fd1f200786 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:32.210480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb49f8-760f-44d6-a941-b5fd1f200786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:32.224297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb49f8-760f-44d6-a941-b5fd1f200786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-79cb49f8-760f-44d6-a941-b5fd1f200786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:28:32.229502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:32.230950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:32.231961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 623/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Mon Oct 3 12:28:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:28:32.237317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327277e-c10c-45e9-ac55-65c90fbe7f55 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:32.294168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:32.354874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327277e-c10c-45e9-ac55-65c90fbe7f55 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:32.392097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:32.392712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:32.392995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:32.393270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:32.393972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:32.394283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:32.395655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:32.403623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 613/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Mon Oct 3 12:28:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:32.410148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb49f8-760f-44d6-a941-b5fd1f200786 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:32.510048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:32.529074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb49f8-760f-44d6-a941-b5fd1f200786 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:32.568312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:32.569046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:32.569377 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:32.569717 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:32.581682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:32.583357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:32.602986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:32.605636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:32.607149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:32.607149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:32.607149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:32.607149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 624/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:32.610956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:32.725851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9594a-08ae-4e12-a3a3-e72b18515bf1 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:32.735718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:32.764580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:32.765275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:32.765582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:32.765859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:32.766542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:32.766885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:32.768418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:32.782324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 614/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:32.787968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:32.903292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedcbb4-343c-48de-b51e-772962ab7c1e None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:32.941832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:32.942608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:32.942995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:32.943374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:32.946241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:32.951632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:32.953138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:28:32.965409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:32.966569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:32.967786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 625/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:32.972838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:33.085319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cf86f-c280-4739-a7f4-4d87c761f173 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:33.121587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:33.122716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:33.123004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:33.123267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:33.123988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:33.124299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:33.125768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:33.144793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 615/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Oct 3 12:28:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:33.151503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:33.272568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff062a3-db03-4a63-aa8e-ebef15922d15 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:33.308327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86115fd-1131-4156-afba-5f85a0d26da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:33.309584 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86115fd-1131-4156-afba-5f85a0d26da7 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:33.309767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86115fd-1131-4156-afba-5f85a0d26da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:33.310055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86115fd-1131-4156-afba-5f85a0d26da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:33.375599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:33.383212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86115fd-1131-4156-afba-5f85a0d26da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:33.384949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86115fd-1131-4156-afba-5f85a0d26da7 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:33.495932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 626/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:28:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:28:33.503667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:33.533931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:33.619439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82214e-ebe0-4b32-ba6c-4b9e7b2c2e36 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:33.658643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:33.659298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:33.659557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:33.659962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:33.671022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:33.672779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:33.690605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:33.694118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:33.695661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:33.695661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:33.695661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:33.695661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 616/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:33.699539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86115fd-1131-4156-afba-5f85a0d26da7 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:33.831236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:33.838449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86115fd-1131-4156-afba-5f85a0d26da7 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:33.882341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:33.883535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:33.883535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:33.883707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:33.884243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:33.884565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:33.885998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:33.898667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 627/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:28:33.905914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:33.998373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:34.023523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187865e4-78ab-463e-9d95-85de7ab79641 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:34.063915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:34.064566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:34.064859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:34.065138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:34.072516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:34.073989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:28:34.087503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:34.089088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:34.091284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 617/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:34.095241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:34.217479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe3f5c-31c2-4803-b592-7db8078410ce None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:34.268452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be35b06-b261-4be8-b490-321541a48b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:34.269456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be35b06-b261-4be8-b490-321541a48b47 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:34.270072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be35b06-b261-4be8-b490-321541a48b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:34.270539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be35b06-b261-4be8-b490-321541a48b47 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:34.271762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be35b06-b261-4be8-b490-321541a48b47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:34.272305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be35b06-b261-4be8-b490-321541a48b47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:34.275016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be35b06-b261-4be8-b490-321541a48b47 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:34.294918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 628/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:28:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:34.302094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:34.424900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f479-0547-4fff-b40e-dc76115892b7 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:34.464939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a36043-e72d-4889-becd-4914b2f4bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:34.466218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a36043-e72d-4889-becd-4914b2f4bc04 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:34.466501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a36043-e72d-4889-becd-4914b2f4bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:34.466774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a36043-e72d-4889-becd-4914b2f4bc04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:34.467507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a36043-e72d-4889-becd-4914b2f4bc04 None admin] RBAC: Adding query filter params (role.id=8620609e2f8a4b039384fd7a3d24253d, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=d0886bba187b4d608cea7dcffed2c2b5) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:34.467820 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a36043-e72d-4889-becd-4914b2f4bc04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:34.469271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a36043-e72d-4889-becd-4914b2f4bc04 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:34.475902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 618/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:28:34 2022] GET /identity/v3/role_assignments?user.id=d0886bba187b4d608cea7dcffed2c2b5&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=8620609e2f8a4b039384fd7a3d24253d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:36.993727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfabe8d-035c-4434-8d48-027b93e96971 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:36.994265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfabe8d-035c-4434-8d48-027b93e96971 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:36.994265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfabe8d-035c-4434-8d48-027b93e96971 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:36.995532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 629/1247] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:37.001302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0002-d651-42d0-a6f7-bd53ea73a7de None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:37.001742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0002-d651-42d0-a6f7-bd53ea73a7de None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:37.001944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e0002-d651-42d0-a6f7-bd53ea73a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:37.008366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:37.021559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c73e0002-d651-42d0-a6f7-bd53ea73a7de None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:37.022771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c73e0002-d651-42d0-a6f7-bd53ea73a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:37.089825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 619/1248] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:37.368269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfabe8d-035c-4434-8d48-027b93e96971 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:37.388326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:37.481120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfabe8d-035c-4434-8d48-027b93e96971 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:37.518085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d122c78-fd2a-42a0-9320-037d8af3eb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:37.518722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122c78-fd2a-42a0-9320-037d8af3eb9a None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:37.519003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122c78-fd2a-42a0-9320-037d8af3eb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:37.519283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d122c78-fd2a-42a0-9320-037d8af3eb9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:37.530243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d122c78-fd2a-42a0-9320-037d8af3eb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-8d122c78-fd2a-42a0-9320-037d8af3eb9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:28:37.535384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:37.536548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:37.537394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 630/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:37.543384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e0002-d651-42d0-a6f7-bd53ea73a7de None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:37.663215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e0002-d651-42d0-a6f7-bd53ea73a7de None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:37.695656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:37.702269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:37.703013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:37.703356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:37.703608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:37.704315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:37.704617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:37.706025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:37.714543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 620/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:37.721052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d122c78-fd2a-42a0-9320-037d8af3eb9a None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:37.807117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:37.830943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d122c78-fd2a-42a0-9320-037d8af3eb9a None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:37.872879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:37.873539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:37.873828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:37.874108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:37.885194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:37.887081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:37.904251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:37.905464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:37.906819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:37.906819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:37.906819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:37.906819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 631/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:37.911654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:38.022379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8105a-6039-4598-a6fd-fae56a2af1e2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:38.061149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:38.061856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:38.062145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:38.062433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:38.063144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:38.063487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:38.064988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:38.079141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 621/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:38.084976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:38.192469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44b09-c623-4fbe-8355-f73e9dc874d0 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:38.221405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:38.230306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:38.230940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:38.231226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:38.231499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:38.241196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:38.242720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:28:38.255010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:38.256236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:38.257339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:38.261031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 632/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:38.262763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:38.329104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:38.380253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74799fbc-6868-4b45-9588-fbb4bbe45033 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:38.424081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:38.424696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:38.424977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:38.425253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:38.426024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:38.426333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:38.427764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:38.451969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 622/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Oct 3 12:28:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:38.458003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:38.590104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79ab35-63d2-4216-b4fd-9183c2fa94ff None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:38.625931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db382b52-bcdf-44d8-b662-5b77b3a60ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:38.626561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382b52-bcdf-44d8-b662-5b77b3a60ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:38.626844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382b52-bcdf-44d8-b662-5b77b3a60ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:38.627121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db382b52-bcdf-44d8-b662-5b77b3a60ee2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:38.692217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:38.703697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db382b52-bcdf-44d8-b662-5b77b3a60ee2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:38.705182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db382b52-bcdf-44d8-b662-5b77b3a60ee2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:38.816180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 633/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:28:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:28:38.822382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:38.928739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31aa69-2d49-491e-9788-0618b29944fa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:38.942749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:38.965080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:38.965780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:38.966060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:38.966332 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:38.978047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:38.979504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:38.996572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:38.997680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:38.998825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:38.998825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:38.998825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:38.998825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 623/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:39.003998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db382b52-bcdf-44d8-b662-5b77b3a60ee2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:39.101975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:39.117120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db382b52-bcdf-44d8-b662-5b77b3a60ee2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:39.153984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:39.154603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:39.154888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:39.155168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:39.155807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:39.156115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:39.157502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:39.169785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 634/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:39.175704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:39.289640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e346cb-3695-47a4-834e-2295ac8113dc None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:39.325083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:39.325742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:39.326029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:39.326306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:39.332824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:39.334306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:28:39.345951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:39.346983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:39.348035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 624/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:39.353142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:39.451529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903d902-994c-43e9-a304-087e3ed14ff0 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:39.485502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f085c-0072-40ae-88b3-8808c1715a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:39.486138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f085c-0072-40ae-88b3-8808c1715a43 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:39.486426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f085c-0072-40ae-88b3-8808c1715a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:39.486700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f085c-0072-40ae-88b3-8808c1715a43 None admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:39.487391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f085c-0072-40ae-88b3-8808c1715a43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:39.487698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f085c-0072-40ae-88b3-8808c1715a43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:39.489136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f085c-0072-40ae-88b3-8808c1715a43 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:39.501275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 635/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:28:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:39.507474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:39.533494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:39.608230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8d89a-0389-47b6-a4a9-105fac23b398 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:39.641058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08841bd3-46a5-4b73-adf1-e8ac9e766a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:39.641688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08841bd3-46a5-4b73-adf1-e8ac9e766a4d None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:39.641972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08841bd3-46a5-4b73-adf1-e8ac9e766a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:39.642250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08841bd3-46a5-4b73-adf1-e8ac9e766a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:39.642976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08841bd3-46a5-4b73-adf1-e8ac9e766a4d None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=d0886bba187b4d608cea7dcffed2c2b5) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:39.643288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08841bd3-46a5-4b73-adf1-e8ac9e766a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:39.644708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08841bd3-46a5-4b73-adf1-e8ac9e766a4d None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:39.649959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 625/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:28:39 2022] GET /identity/v3/role_assignments?user.id=d0886bba187b4d608cea7dcffed2c2b5&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:41.747628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467ba4-8d1f-4576-8321-eff75b8bb243 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:41.748159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467ba4-8d1f-4576-8321-eff75b8bb243 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:41.748159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467ba4-8d1f-4576-8321-eff75b8bb243 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:41.749505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 636/1261] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:41.754918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ae3b-63e4-4a47-8a3c-1fa0f9e0ae8b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:41.755451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ae3b-63e4-4a47-8a3c-1fa0f9e0ae8b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:41.755586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136ae3b-63e4-4a47-8a3c-1fa0f9e0ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:41.774345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9136ae3b-63e4-4a47-8a3c-1fa0f9e0ae8b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:41.775527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9136ae3b-63e4-4a47-8a3c-1fa0f9e0ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:41.841617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 626/1262] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:42.111131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467ba4-8d1f-4576-8321-eff75b8bb243 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:42.122535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:42.211578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467ba4-8d1f-4576-8321-eff75b8bb243 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:42.248151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33a711-77e7-4bba-b801-d2d327513466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:42.248832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33a711-77e7-4bba-b801-d2d327513466 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:42.249149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33a711-77e7-4bba-b801-d2d327513466 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:42.249468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33a711-77e7-4bba-b801-d2d327513466 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:42.261982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33a711-77e7-4bba-b801-d2d327513466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-9f33a711-77e7-4bba-b801-d2d327513466 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:28:42.267637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:42.268972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:42.270240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 637/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:28:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:42.275553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136ae3b-63e4-4a47-8a3c-1fa0f9e0ae8b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:42.296625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:42.378322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136ae3b-63e4-4a47-8a3c-1fa0f9e0ae8b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:42.411927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:42.412531 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:42.412813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:42.413087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:42.413774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:42.414082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:42.415440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:42.423848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 627/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:42.429821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33a711-77e7-4bba-b801-d2d327513466 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:42.496354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:42.530239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33a711-77e7-4bba-b801-d2d327513466 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:42.562940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:42.563547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:42.563823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:42.564096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:42.574230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:42.575670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:42.590086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:42.591199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:42.592334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:42.592334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:42.592334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:42.592334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 638/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:42.598732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:42.677417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:42.696518 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae3110-7ea1-4581-b0ca-9c8573170cc6 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:42.731045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:42.731657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:42.731938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:42.732211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:42.732854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:42.733160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:42.734548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:42.746085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 628/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:42.751872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:42.851244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca92dd-a877-498c-bc90-efe6235375b2 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:42.870932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:42.885251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:42.885902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:42.886710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:42.886983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:42.894387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:42.895822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:28:42.907394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:42.908519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:42.909537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 639/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:42.914389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:43.010825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1349c36-915a-4f68-af36-b294081de4e2 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:43.043648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:43.044249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:43.044530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:43.044803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:43.045540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:43.045854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:43.047268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:43.055667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:43.064931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 629/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Oct 3 12:28:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:43.070683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:43.169145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c0fd-3ccb-4641-97b4-39131240f7dc None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:43.204781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:43.205364 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:43.205681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:43.205954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:43.216524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:43.218013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:43.232168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:43.233255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:43.234248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:43.234248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:43.234248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:43.234248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 640/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:43.239515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:43.343758 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e5284-8944-48b1-9382-77fd77049859 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:43.377723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:43.378325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:43.378608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:43.378884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:43.379522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:43.379830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:43.381190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:43.392692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 630/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:43.398243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:43.429715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:43.500851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f890cf-99a0-4d75-a0cb-0fb164f236ec None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:43.537161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:43.537819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:43.538107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:43.538386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:43.545483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:43.546951 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:28:43.558574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:43.559610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:43.560727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 641/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:43.565556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:43.623260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:43.665906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bd242-27a0-4a34-b8c7-f529d62972ee None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:43.698855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15e3c1-34f7-473a-ae6a-85c2f6dd186f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:43.699467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15e3c1-34f7-473a-ae6a-85c2f6dd186f None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:43.699745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15e3c1-34f7-473a-ae6a-85c2f6dd186f None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:43.700021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15e3c1-34f7-473a-ae6a-85c2f6dd186f None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:43.700714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15e3c1-34f7-473a-ae6a-85c2f6dd186f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:43.701019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15e3c1-34f7-473a-ae6a-85c2f6dd186f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:43.702471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15e3c1-34f7-473a-ae6a-85c2f6dd186f None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:43.714787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 631/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:43.720690 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:43.813902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:43.823253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b94def-0e38-470c-bdca-4fee27da9ccb None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:43.858680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c729c-6f07-48ac-93f5-3e7a1d989da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:43.859341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c729c-6f07-48ac-93f5-3e7a1d989da5 None admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:43.859626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c729c-6f07-48ac-93f5-3e7a1d989da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:43.859901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c729c-6f07-48ac-93f5-3e7a1d989da5 None admin] PATH_INFO: `/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/d0886bba187b4d608cea7dcffed2c2b5/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:43.861825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c729c-6f07-48ac-93f5-3e7a1d989da5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbb691badbf41cdaf8be15693336c2b, user_id=d0886bba187b4d608cea7dcffed2c2b5, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:43.863254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c729c-6f07-48ac-93f5-3e7a1d989da5 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:43.877129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 642/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Mon Oct 3 12:28:43 2022] PUT /identity/v3/projects/6cbb691badbf41cdaf8be15693336c2b/users/d0886bba187b4d608cea7dcffed2c2b5/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:28:46.000713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977356f1-2436-4aea-9303-d879ce747622 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:46.001244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977356f1-2436-4aea-9303-d879ce747622 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:46.001244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977356f1-2436-4aea-9303-d879ce747622 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:46.002557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 632/1274] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:46.007956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82db6c-de9e-412c-8c1e-0702516a6c6d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:46.008374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82db6c-de9e-412c-8c1e-0702516a6c6d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:46.008503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82db6c-de9e-412c-8c1e-0702516a6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:46.026271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1b82db6c-de9e-412c-8c1e-0702516a6c6d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:46.027981 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1b82db6c-de9e-412c-8c1e-0702516a6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:46.092555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 643/1275] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:46.360224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977356f1-2436-4aea-9303-d879ce747622 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:46.463571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977356f1-2436-4aea-9303-d879ce747622 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:46.481461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:46.497593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e055-cacd-4dfe-9365-805346f3b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:46.498223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e055-cacd-4dfe-9365-805346f3b1fa None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:46.498501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e055-cacd-4dfe-9365-805346f3b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:46.498772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e055-cacd-4dfe-9365-805346f3b1fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:46.508675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9e055-cacd-4dfe-9365-805346f3b1fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-98e9e055-cacd-4dfe-9365-805346f3b1fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 03 12:28:46.514016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:46.515133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:46.518610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 633/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Mon Oct 3 12:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:46.521150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82db6c-de9e-412c-8c1e-0702516a6c6d None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:46.602592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:46.621308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82db6c-de9e-412c-8c1e-0702516a6c6d None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:46.655059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:46.655662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:46.655942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:46.656212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:46.656865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:46.657167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:46.658554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:46.666606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 644/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Mon Oct 3 12:28:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:46.672473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e055-cacd-4dfe-9365-805346f3b1fa None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:46.770473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e055-cacd-4dfe-9365-805346f3b1fa None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:46.805633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:46.806263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:46.806546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:46.806813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:46.817761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:46.819211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:46.834698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:46.836157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:46.837237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:46.837237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:46.837237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:46.837237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 634/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:46.841757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:46.943840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364046b8-0e4a-47ac-bc08-b4f39e227ce6 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:46.979496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:46.980108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:46.980389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:46.980665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:46.981312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:46.981654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:46.983030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:46.995565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 645/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:47.001249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:47.032180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:47.101214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652def-3de1-43dc-a9aa-14f6353e40ce None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:47.134905 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:47.135530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:47.135844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:47.136118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:47.143834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:47.145272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 03 12:28:47.156376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:47.157541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:47.158565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 635/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:47.163517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:47.167837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:47.267008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5854c-59ae-47de-8680-b79132550965 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:47.300296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:47.300897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:47.301174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:47.301445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:47.302193 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:47.302502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:47.303931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:47.321095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 646/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Mon Oct 3 12:28:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:47.327121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:47.424863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:47.435421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13372d7-dbaa-4a96-b9e3-3cae38a0c15b None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:47.469306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a496f19-921d-4d44-9a71-3679b6014e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:47.469955 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496f19-921d-4d44-9a71-3679b6014e42 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:47.470238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496f19-921d-4d44-9a71-3679b6014e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:47.470513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496f19-921d-4d44-9a71-3679b6014e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:47.537594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a496f19-921d-4d44-9a71-3679b6014e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:47.538956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a496f19-921d-4d44-9a71-3679b6014e42 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:47.631784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:47.642576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 636/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Mon Oct 3 12:28:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 03 12:28:47.648698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:47.710066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:47.750928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fa964-30d1-4749-93a3-47a0fd9e2daa None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:47.785748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:47.786409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:47.786694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:47.786965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:47.797181 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:47.798623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 03 12:28:47.814133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:47.815352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 03 12:28:47.816489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 03 12:28:47.816489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 03 12:28:47.816489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:47.816489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 647/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:47.821133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a496f19-921d-4d44-9a71-3679b6014e42 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:47.924433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a496f19-921d-4d44-9a71-3679b6014e42 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:47.957936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:47.958550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:47.958828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:47.959104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:47.959733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:47.960033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:47.961385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:47.974124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 637/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Mon Oct 3 12:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:47.980450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:48.084490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce444b5-d5a1-4900-ae25-be758f58eb61 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:48.098159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:48.118481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:48.119093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:48.119371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:48.119642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:48.126225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:48.127665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 03 12:28:48.139299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:48.140351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: ERROR keystone.server.flask.application Oct 03 12:28:48.141290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 648/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Mon Oct 3 12:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 03 12:28:48.146287 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:48.195911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:48.247538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d808e1-11bf-4776-bfe6-9ad0f6c6af78 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:48.284632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721da76-b312-46a9-82a0-22f2905609c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:48.285248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721da76-b312-46a9-82a0-22f2905609c4 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:48.285570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721da76-b312-46a9-82a0-22f2905609c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:48.285903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721da76-b312-46a9-82a0-22f2905609c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:48.286598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721da76-b312-46a9-82a0-22f2905609c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:48.286907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721da76-b312-46a9-82a0-22f2905609c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:48.288347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721da76-b312-46a9-82a0-22f2905609c4 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:48.300622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 638/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Mon Oct 3 12:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:48.306915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:48.406255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fab5b-cada-4ec1-96f8-035e508aed55 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:48.438734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1e3a-2f38-43d5-8ccd-c6dce426fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:48.439329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1e3a-2f38-43d5-8ccd-c6dce426fdef None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:48.439607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1e3a-2f38-43d5-8ccd-c6dce426fdef None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:48.439877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1e3a-2f38-43d5-8ccd-c6dce426fdef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:48.440586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb1e3a-2f38-43d5-8ccd-c6dce426fdef None admin] RBAC: Adding query filter params (role.id=740f7ce58cf44605a43cd3f0ba43f384, scope.project.id=6cbb691badbf41cdaf8be15693336c2b, user.id=d0886bba187b4d608cea7dcffed2c2b5) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:48.440893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb1e3a-2f38-43d5-8ccd-c6dce426fdef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:48.442334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb1e3a-2f38-43d5-8ccd-c6dce426fdef None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:48.448840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 649/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Mon Oct 3 12:28:48 2022] GET /identity/v3/role_assignments?user.id=d0886bba187b4d608cea7dcffed2c2b5&scope.project.id=6cbb691badbf41cdaf8be15693336c2b&role.id=740f7ce58cf44605a43cd3f0ba43f384 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:50.657239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f647-bb1d-46c4-aaa9-066de3fe373a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:50.657901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f647-bb1d-46c4-aaa9-066de3fe373a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:50.658005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f647-bb1d-46c4-aaa9-066de3fe373a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:50.659459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 639/1288] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:50.664863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9bdc3-98ce-4bd7-baee-beea40bafa66 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:50.665316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9bdc3-98ce-4bd7-baee-beea40bafa66 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:50.665427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9bdc3-98ce-4bd7-baee-beea40bafa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:50.684106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-14c9bdc3-98ce-4bd7-baee-beea40bafa66 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:50.685299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-14c9bdc3-98ce-4bd7-baee-beea40bafa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:50.715958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:50.753776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 650/1289] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:51.022884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f647-bb1d-46c4-aaa9-066de3fe373a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:51.121755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f647-bb1d-46c4-aaa9-066de3fe373a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:51.132193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:51.157010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:51.157669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:51.157960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:51.158238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:51.158822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:51.160183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:51.168890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:51.170164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:51.171312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 640/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:28:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:51.176021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9bdc3-98ce-4bd7-baee-beea40bafa66 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:51.281197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9bdc3-98ce-4bd7-baee-beea40bafa66 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:51.320201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9e35b-191e-45f2-901b-3b6daee69219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:51.320815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e35b-191e-45f2-901b-3b6daee69219 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:51.321098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e35b-191e-45f2-901b-3b6daee69219 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:51.321375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e35b-191e-45f2-901b-3b6daee69219 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:51.322039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9e35b-191e-45f2-901b-3b6daee69219 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:51.322352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9e35b-191e-45f2-901b-3b6daee69219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:51.324344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9e35b-191e-45f2-901b-3b6daee69219 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:51.329101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 651/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Mon Oct 3 12:28:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:51.334993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:51.430315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ad771-5dcf-45ce-8872-cba2d008aa5a None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:51.463779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f586f7-6080-4bdf-b019-71c79117e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:51.464451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f586f7-6080-4bdf-b019-71c79117e425 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:51.464761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f586f7-6080-4bdf-b019-71c79117e425 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:51.465040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f586f7-6080-4bdf-b019-71c79117e425 None admin] PATH_INFO: `/v3/services` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:51.465702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f586f7-6080-4bdf-b019-71c79117e425 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:51.466013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f586f7-6080-4bdf-b019-71c79117e425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:51.467369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f586f7-6080-4bdf-b019-71c79117e425 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:51.471716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 641/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Mon Oct 3 12:28:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:53.652685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488decb-dcbe-4f12-ae55-908cc572e302 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:53.653256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488decb-dcbe-4f12-ae55-908cc572e302 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:53.653256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488decb-dcbe-4f12-ae55-908cc572e302 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:53.654598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 652/1293] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:53.660029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8698-7655-4904-9595-e398847d5bb7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:53.660471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8698-7655-4904-9595-e398847d5bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:53.660572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8698-7655-4904-9595-e398847d5bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:53.680247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2fcc8698-7655-4904-9595-e398847d5bb7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:53.681448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2fcc8698-7655-4904-9595-e398847d5bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:53.713264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:53.756097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 642/1294] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:28:54.024334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488decb-dcbe-4f12-ae55-908cc572e302 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:54.056114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:54.135299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488decb-dcbe-4f12-ae55-908cc572e302 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:54.169975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58963c-8237-4c3c-a3ae-b38d183b17dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:54.170581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58963c-8237-4c3c-a3ae-b38d183b17dc None admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:54.170861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58963c-8237-4c3c-a3ae-b38d183b17dc None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:54.171136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58963c-8237-4c3c-a3ae-b38d183b17dc None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:54.171787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58963c-8237-4c3c-a3ae-b38d183b17dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:54.173166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58963c-8237-4c3c-a3ae-b38d183b17dc None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:54.188478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 653/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Mon Oct 3 12:28:54 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:28:56.360428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b637-b7c7-4a42-995c-94bc933fd799 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:56.361059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b637-b7c7-4a42-995c-94bc933fd799 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:56.361059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b637-b7c7-4a42-995c-94bc933fd799 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:56.362365 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 643/1296] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:56.367842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846dfa-5e05-4f22-b0db-f7a72dba7c90 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:56.368355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846dfa-5e05-4f22-b0db-f7a72dba7c90 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:56.368489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846dfa-5e05-4f22-b0db-f7a72dba7c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:56.387280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e2846dfa-5e05-4f22-b0db-f7a72dba7c90 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:56.388465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e2846dfa-5e05-4f22-b0db-f7a72dba7c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:56.464425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 654/1297] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 03 12:28:56.727995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58b637-b7c7-4a42-995c-94bc933fd799 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:56.831819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58b637-b7c7-4a42-995c-94bc933fd799 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:56.868371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:56.869000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:56.869281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:56.869580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:56.870730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:56.871584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:28:56.880755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:28:56.882235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:28:56.883372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 644/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:28:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:28:56.891080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846dfa-5e05-4f22-b0db-f7a72dba7c90 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:56.910645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:57.018870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846dfa-5e05-4f22-b0db-f7a72dba7c90 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:57.054439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:57.055061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:57.055346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:57.055631 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:57.056271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:57.056580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:57.058037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:57.063922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 655/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Mon Oct 3 12:28:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:28:57.070436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:57.103601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:57.176583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d50fd-abe3-4b31-8992-bc214c9fbd1c None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:57.212104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d03ee-e829-4f00-955a-21c20740c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:57.212722 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d03ee-e829-4f00-955a-21c20740c072 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:57.213005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d03ee-e829-4f00-955a-21c20740c072 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:57.213281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d03ee-e829-4f00-955a-21c20740c072 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:57.214057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d03ee-e829-4f00-955a-21c20740c072 None admin] RBAC: Adding query filter params (interface=public, service_id=551873e2f7fe4e769dab040489014ae4, region_id=RegionOne) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:28:57.214371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d03ee-e829-4f00-955a-21c20740c072 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:57.215747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d03ee-e829-4f00-955a-21c20740c072 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:57.223199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 645/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Mon Oct 3 12:28:57 2022] GET /identity/v3/endpoints?service_id=551873e2f7fe4e769dab040489014ae4&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:28:57.229895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:28:57.328337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:28:57.350657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ec6c3-e41d-42a5-bcd3-9cb883a1c025 None admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:28:57.389017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e738c2-0782-45dd-8b7d-6a2e5b8668a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:28:57.389784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e738c2-0782-45dd-8b7d-6a2e5b8668a3 None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:57.389926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e738c2-0782-45dd-8b7d-6a2e5b8668a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:57.390194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e738c2-0782-45dd-8b7d-6a2e5b8668a3 None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:57.390789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e738c2-0782-45dd-8b7d-6a2e5b8668a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:28:57.392147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e738c2-0782-45dd-8b7d-6a2e5b8668a3 None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:28:57.398928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 656/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Mon Oct 3 12:28:57 2022] GET /identity/v3/services => generated 2191 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:28:59.601792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722e895-4d71-48d0-8cae-b28cd645ca11 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:59.602336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722e895-4d71-48d0-8cae-b28cd645ca11 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:59.602336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722e895-4d71-48d0-8cae-b28cd645ca11 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:59.603655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 646/1302] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:28:59.609100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06cf4d-428f-4202-b6ae-df47fffd6b6a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:28:59.609582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06cf4d-428f-4202-b6ae-df47fffd6b6a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:28:59.609679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06cf4d-428f-4202-b6ae-df47fffd6b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:28:59.628379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-9f06cf4d-428f-4202-b6ae-df47fffd6b6a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:28:59.629623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9f06cf4d-428f-4202-b6ae-df47fffd6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:28:59.698522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 657/1303] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:28:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 03 12:29:00.005606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722e895-4d71-48d0-8cae-b28cd645ca11 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:29:00.102276 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:29:00.110539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722e895-4d71-48d0-8cae-b28cd645ca11 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:29:00.146885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:29:00.147519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:29:00.147801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:29:00.148077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:29:00.148667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:29:00.150068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 03 12:29:00.159451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 03 12:29:00.160825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.get_or_create( Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application with Lock( Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self._enter() Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application return self.creator() Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application created_value = creator( Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: ERROR keystone.server.flask.application Oct 03 12:29:00.162082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 647/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Mon Oct 3 12:29:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 03 12:29:00.167296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06cf4d-428f-4202-b6ae-df47fffd6b6a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:29:00.246160 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:29:00.269087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06cf4d-428f-4202-b6ae-df47fffd6b6a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:29:00.304394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec0b03-bdf1-40d6-8194-3bb2757e6afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:29:00.305026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec0b03-bdf1-40d6-8194-3bb2757e6afd None admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:29:00.305311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec0b03-bdf1-40d6-8194-3bb2757e6afd None admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:29:00.305627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec0b03-bdf1-40d6-8194-3bb2757e6afd None admin] PATH_INFO: `/v3/services` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:29:00.306256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec0b03-bdf1-40d6-8194-3bb2757e6afd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:29:00.306559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec0b03-bdf1-40d6-8194-3bb2757e6afd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:29:00.307965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec0b03-bdf1-40d6-8194-3bb2757e6afd None admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:29:00.314262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 658/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Mon Oct 3 12:29:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:29:00.320235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:29:00.418290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337c5a4-6401-4e0d-86dd-fd9f60101578 None admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:29:00.450656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e892151-422e-4ba4-b956-a3055eedda30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:29:00.451255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892151-422e-4ba4-b956-a3055eedda30 None admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:29:00.451536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892151-422e-4ba4-b956-a3055eedda30 None admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:29:00.451811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e892151-422e-4ba4-b956-a3055eedda30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:29:00.452485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892151-422e-4ba4-b956-a3055eedda30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:29:00.453865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e892151-422e-4ba4-b956-a3055eedda30 None admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:29:00.472841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 648/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:29:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:29:10.310201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=30 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:29:10.469099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:11.938228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f083e5-4cfb-4c1a-9d8e-79c9a7d0c9ba None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:11.939115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f083e5-4cfb-4c1a-9d8e-79c9a7d0c9ba None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:11.939115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f083e5-4cfb-4c1a-9d8e-79c9a7d0c9ba None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:11.942420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 659/1307] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:30:11.952221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e9f7-1e0a-41f7-b2de-4d6e869d7f5a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:11.953114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e9f7-1e0a-41f7-b2de-4d6e869d7f5a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:11.953260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e9f7-1e0a-41f7-b2de-4d6e869d7f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:12.149667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-70a1e9f7-1e0a-41f7-b2de-4d6e869d7f5a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:12.151922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-70a1e9f7-1e0a-41f7-b2de-4d6e869d7f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:12.548939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 649/1308] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:30:13.130098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724806-5f5d-41e4-bf92-a56d8bf96c5f None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:13.131573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724806-5f5d-41e4-bf92-a56d8bf96c5f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:13.132385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f724806-5f5d-41e4-bf92-a56d8bf96c5f None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:13.135809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 660/1309] 10.222.0.17 () {54 vars in 964 bytes} [Mon Oct 3 12:30:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:30:13.147719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0bf1-2830-4e54-b691-cca83caad810 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:13.149282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0bf1-2830-4e54-b691-cca83caad810 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:13.150232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0bf1-2830-4e54-b691-cca83caad810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:13.335277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-083c0bf1-2830-4e54-b691-cca83caad810 None None] MFA Rules not processed for user `323b7d02f817475791098f32bf1c953e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:13.336845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-083c0bf1-2830-4e54-b691-cca83caad810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:13.365428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:13.526092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 650/1310] 10.222.0.17 () {58 vars in 1061 bytes} [Mon Oct 3 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:30:13.554006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f724806-5f5d-41e4-bf92-a56d8bf96c5f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:13.558023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0f724806-5f5d-41e4-bf92-a56d8bf96c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:14.282597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f724806-5f5d-41e4-bf92-a56d8bf96c5f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:14.572228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463e785-5c97-4a7d-9ba2-b1fcf9845431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:14.573280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463e785-5c97-4a7d-9ba2-b1fcf9845431 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:14.573844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463e785-5c97-4a7d-9ba2-b1fcf9845431 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:14.574346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463e785-5c97-4a7d-9ba2-b1fcf9845431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:14.577721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b463e785-5c97-4a7d-9ba2-b1fcf9845431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:14.670130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:14.806872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463e785-5c97-4a7d-9ba2-b1fcf9845431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:14.809730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463e785-5c97-4a7d-9ba2-b1fcf9845431 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:14.893060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 661/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:30:17.566129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a9a5-c4b0-464a-bbf2-bdcdebec0ef4 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:17.566941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a9a5-c4b0-464a-bbf2-bdcdebec0ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:17.566941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7a9a5-c4b0-464a-bbf2-bdcdebec0ef4 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:17.568066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 651/1312] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:30:17.575154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb81b-e01f-43f5-9042-85b935240a35 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:17.575729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb81b-e01f-43f5-9042-85b935240a35 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:17.576173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfb81b-e01f-43f5-9042-85b935240a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:17.709341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-34dfb81b-e01f-43f5-9042-85b935240a35 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:17.710734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-34dfb81b-e01f-43f5-9042-85b935240a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:17.832272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 662/1313] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:30:18.129389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7a9a5-c4b0-464a-bbf2-bdcdebec0ef4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:18.132284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-96c7a9a5-c4b0-464a-bbf2-bdcdebec0ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:18.277537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7a9a5-c4b0-464a-bbf2-bdcdebec0ef4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:18.371738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:18.374662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478f48a-431d-4a29-ab38-b88bbd0dec93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:18.375643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f48a-431d-4a29-ab38-b88bbd0dec93 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:18.376258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f48a-431d-4a29-ab38-b88bbd0dec93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:18.376825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f48a-431d-4a29-ab38-b88bbd0dec93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:18.378780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6478f48a-431d-4a29-ab38-b88bbd0dec93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:18.515736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478f48a-431d-4a29-ab38-b88bbd0dec93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:18.517206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478f48a-431d-4a29-ab38-b88bbd0dec93 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:18.542838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 652/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:30:21.200647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a459a2d-1ba3-4cf6-91c7-11ed9522e772 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:21.201352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a459a2d-1ba3-4cf6-91c7-11ed9522e772 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:21.201667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a459a2d-1ba3-4cf6-91c7-11ed9522e772 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:21.204132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 663/1315] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:30:21.211004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf4c8-e0f0-49f2-acca-02776a620af2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:21.211618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf4c8-e0f0-49f2-acca-02776a620af2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:21.211618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cf4c8-e0f0-49f2-acca-02776a620af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:21.312553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-bf1cf4c8-e0f0-49f2-acca-02776a620af2 None None] MFA Rules not processed for user `2fb468f388b34796930d45da65c93c90`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:21.313255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bf1cf4c8-e0f0-49f2-acca-02776a620af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:21.381994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:21.435757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 653/1316] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:30:21.739131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cdd2-d5b9-4496-8fca-49465d814359 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:21.739421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cdd2-d5b9-4496-8fca-49465d814359 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:21.739704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930cdd2-d5b9-4496-8fca-49465d814359 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:21.741103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 664/1317] 10.222.0.17 () {54 vars in 964 bytes} [Mon Oct 3 12:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:30:21.747822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ece0-68ba-4dea-9f64-555bb4571eae None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:21.748270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ece0-68ba-4dea-9f64-555bb4571eae None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:21.748670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ece0-68ba-4dea-9f64-555bb4571eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:21.843068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4eb7ece0-68ba-4dea-9f64-555bb4571eae None None] MFA Rules not processed for user `323b7d02f817475791098f32bf1c953e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:21.844598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4eb7ece0-68ba-4dea-9f64-555bb4571eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:21.937406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 654/1318] 10.222.0.17 () {58 vars in 1061 bytes} [Mon Oct 3 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:30:21.947716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930cdd2-d5b9-4496-8fca-49465d814359 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:21.949264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7930cdd2-d5b9-4496-8fca-49465d814359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:21.962196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:22.074142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930cdd2-d5b9-4496-8fca-49465d814359 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:22.214728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fa211-bfaf-4799-8521-3cc5155b08a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:22.215709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa211-bfaf-4799-8521-3cc5155b08a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:22.216220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa211-bfaf-4799-8521-3cc5155b08a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:22.216747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa211-bfaf-4799-8521-3cc5155b08a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:22.220511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-dc9fa211-bfaf-4799-8521-3cc5155b08a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:22.313175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:22.371282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fa211-bfaf-4799-8521-3cc5155b08a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:22.372773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fa211-bfaf-4799-8521-3cc5155b08a0 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:22.394762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 665/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:30:26.017306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea65e-2878-490b-9afb-b1cfb6c99574 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:26.018012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea65e-2878-490b-9afb-b1cfb6c99574 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:26.018012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ea65e-2878-490b-9afb-b1cfb6c99574 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:26.019363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 655/1320] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:30:26.026446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4fc11-b73c-43d4-bca2-26a31b5ccc43 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:26.027052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4fc11-b73c-43d4-bca2-26a31b5ccc43 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:26.027482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4fc11-b73c-43d4-bca2-26a31b5ccc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:26.125563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-36b4fc11-b73c-43d4-bca2-26a31b5ccc43 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:26.127026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-36b4fc11-b73c-43d4-bca2-26a31b5ccc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:26.243595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 666/1321] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:30:26.546026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea65e-2878-490b-9afb-b1cfb6c99574 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:26.547656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8e6ea65e-2878-490b-9afb-b1cfb6c99574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:26.609357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:26.676760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ea65e-2878-490b-9afb-b1cfb6c99574 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:26.767986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a8985-a8c0-49b4-93ef-7618c566344f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:26.768679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a8985-a8c0-49b4-93ef-7618c566344f service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:26.769006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a8985-a8c0-49b4-93ef-7618c566344f service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:26.769326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a8985-a8c0-49b4-93ef-7618c566344f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:26.771191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-738a8985-a8c0-49b4-93ef-7618c566344f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:26.892685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:26.908961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a8985-a8c0-49b4-93ef-7618c566344f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:26.911937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a8985-a8c0-49b4-93ef-7618c566344f service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:26.933684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 656/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:30:30.437771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47388e2-aaaf-4b6d-b9f9-22a546cb6e23 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:30.439267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47388e2-aaaf-4b6d-b9f9-22a546cb6e23 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:30.439267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47388e2-aaaf-4b6d-b9f9-22a546cb6e23 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:30.440459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 667/1323] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:30:30.446757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9312-53d9-47b5-8095-2366315613a7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:30.447651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9312-53d9-47b5-8095-2366315613a7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:30.447651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe9312-53d9-47b5-8095-2366315613a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:30.540916 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2dfe9312-53d9-47b5-8095-2366315613a7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:30.543236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2dfe9312-53d9-47b5-8095-2366315613a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:30.685789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 657/1324] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:30:31.093432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47388e2-aaaf-4b6d-b9f9-22a546cb6e23 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:31.096866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e47388e2-aaaf-4b6d-b9f9-22a546cb6e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:31.133447 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:31.291250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47388e2-aaaf-4b6d-b9f9-22a546cb6e23 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:31.411428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e617177-49b2-43f8-97c3-aa41f82798ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:31.412052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e617177-49b2-43f8-97c3-aa41f82798ff service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:31.412332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e617177-49b2-43f8-97c3-aa41f82798ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:31.412603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e617177-49b2-43f8-97c3-aa41f82798ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:31.414382 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4e617177-49b2-43f8-97c3-aa41f82798ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:31.551795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:31.630354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e617177-49b2-43f8-97c3-aa41f82798ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:31.631838 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e617177-49b2-43f8-97c3-aa41f82798ff service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:31.657493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 668/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:30:34.306577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e112567-7e9f-4b8c-b4b0-add6fd1b66af None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:34.307370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e112567-7e9f-4b8c-b4b0-add6fd1b66af None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:34.307370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e112567-7e9f-4b8c-b4b0-add6fd1b66af None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:34.308585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 658/1326] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:30:34.315301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33e1e-841c-4f19-8718-e974fc43aa6b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:34.316071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33e1e-841c-4f19-8718-e974fc43aa6b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:34.316071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33e1e-841c-4f19-8718-e974fc43aa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:34.412853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-50d33e1e-841c-4f19-8718-e974fc43aa6b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:34.415296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-50d33e1e-841c-4f19-8718-e974fc43aa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:34.571583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 669/1327] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:30:34.927571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e112567-7e9f-4b8c-b4b0-add6fd1b66af None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:34.929137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0e112567-7e9f-4b8c-b4b0-add6fd1b66af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:35.007945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:35.063439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e112567-7e9f-4b8c-b4b0-add6fd1b66af None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:35.175131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac30b4-0a52-49ad-9a1e-6f13b0a26861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:35.175995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac30b4-0a52-49ad-9a1e-6f13b0a26861 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:35.176446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac30b4-0a52-49ad-9a1e-6f13b0a26861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:35.176867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac30b4-0a52-49ad-9a1e-6f13b0a26861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:35.178784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bdac30b4-0a52-49ad-9a1e-6f13b0a26861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:35.342074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:35.346783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac30b4-0a52-49ad-9a1e-6f13b0a26861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:35.348708 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac30b4-0a52-49ad-9a1e-6f13b0a26861 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:35.372775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 659/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:30:38.013114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b4bf5-27ce-4be6-81ac-22b644d67978 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:38.013869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b4bf5-27ce-4be6-81ac-22b644d67978 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:38.013869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b4bf5-27ce-4be6-81ac-22b644d67978 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:38.015944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 670/1329] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:30:38.021240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412dcf8-f4bb-4beb-9432-c290896fb8ed None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:38.021950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412dcf8-f4bb-4beb-9432-c290896fb8ed None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:38.022036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412dcf8-f4bb-4beb-9432-c290896fb8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:38.108657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e412dcf8-f4bb-4beb-9432-c290896fb8ed None None] MFA Rules not processed for user `2fb468f388b34796930d45da65c93c90`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:38.110299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e412dcf8-f4bb-4beb-9432-c290896fb8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:38.282900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 660/1330] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:30:38.639879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b4bf5-27ce-4be6-81ac-22b644d67978 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:38.641547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-aa1b4bf5-27ce-4be6-81ac-22b644d67978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:38.690544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:38.828798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b4bf5-27ce-4be6-81ac-22b644d67978 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:38.978039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438c3c0-dbb1-4796-81cb-5c7c879268bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:38.979085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c3c0-dbb1-4796-81cb-5c7c879268bd service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:38.979580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c3c0-dbb1-4796-81cb-5c7c879268bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:38.980055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c3c0-dbb1-4796-81cb-5c7c879268bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:38.983227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4438c3c0-dbb1-4796-81cb-5c7c879268bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:39.215393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:39.279942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438c3c0-dbb1-4796-81cb-5c7c879268bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:39.279942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438c3c0-dbb1-4796-81cb-5c7c879268bd service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:39.313846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 671/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:30:41.908398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949652f-4d67-42f4-ad9c-3bca0c1f60dc None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:41.908997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949652f-4d67-42f4-ad9c-3bca0c1f60dc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:41.909436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949652f-4d67-42f4-ad9c-3bca0c1f60dc None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:41.911155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 661/1332] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:30:41.917290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5348d3-d971-4c38-9a66-39ef43e2a65b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:41.917909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5348d3-d971-4c38-9a66-39ef43e2a65b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:41.917909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5348d3-d971-4c38-9a66-39ef43e2a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:42.002353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7c5348d3-d971-4c38-9a66-39ef43e2a65b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:42.003623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7c5348d3-d971-4c38-9a66-39ef43e2a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:42.121323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 672/1333] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:30:42.411278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949652f-4d67-42f4-ad9c-3bca0c1f60dc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:42.412972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1949652f-4d67-42f4-ad9c-3bca0c1f60dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:42.495240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:42.537474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949652f-4d67-42f4-ad9c-3bca0c1f60dc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:42.624913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f3810-60ac-4d02-bba2-1a351b65e074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:42.625673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3810-60ac-4d02-bba2-1a351b65e074 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:42.626004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3810-60ac-4d02-bba2-1a351b65e074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:42.626323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3810-60ac-4d02-bba2-1a351b65e074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:42.628079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-163f3810-60ac-4d02-bba2-1a351b65e074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:42.769485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f3810-60ac-4d02-bba2-1a351b65e074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:42.770982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f3810-60ac-4d02-bba2-1a351b65e074 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:42.783522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:42.793594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 662/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:30:45.171902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466fd6-8adb-47aa-a8f7-062606b407c5 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:45.172507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466fd6-8adb-47aa-a8f7-062606b407c5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:45.172507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466fd6-8adb-47aa-a8f7-062606b407c5 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:45.173898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 673/1335] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:30:45.182502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f87024-bbe6-4115-b23d-e9c7b4bfcd13 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:45.183087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f87024-bbe6-4115-b23d-e9c7b4bfcd13 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:45.183087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f87024-bbe6-4115-b23d-e9c7b4bfcd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:45.307085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a3f87024-bbe6-4115-b23d-e9c7b4bfcd13 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:45.309382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a3f87024-bbe6-4115-b23d-e9c7b4bfcd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:45.446103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 663/1336] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:30:45.743599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7466fd6-8adb-47aa-a8f7-062606b407c5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:45.745232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b7466fd6-8adb-47aa-a8f7-062606b407c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:45.793796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:45.871617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7466fd6-8adb-47aa-a8f7-062606b407c5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:45.978786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfb05a-fb70-4eb0-acf5-61a8a0c970f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:45.979475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb05a-fb70-4eb0-acf5-61a8a0c970f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:45.979805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb05a-fb70-4eb0-acf5-61a8a0c970f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:45.980128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb05a-fb70-4eb0-acf5-61a8a0c970f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:45.981965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7bdfb05a-fb70-4eb0-acf5-61a8a0c970f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:46.083159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:46.114677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfb05a-fb70-4eb0-acf5-61a8a0c970f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:46.116159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfb05a-fb70-4eb0-acf5-61a8a0c970f5 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:46.138293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 674/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:30:48.885952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4554c-3292-41e7-acff-e6e864125ba9 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:48.886816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4554c-3292-41e7-acff-e6e864125ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:48.886981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4554c-3292-41e7-acff-e6e864125ba9 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:48.888404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 664/1338] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:30:48.894349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c0c0-4368-437b-b42e-521b2de3066d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:48.894890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c0c0-4368-437b-b42e-521b2de3066d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:48.894890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c0c0-4368-437b-b42e-521b2de3066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:48.972375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5f41c0c0-4368-437b-b42e-521b2de3066d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:48.973541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5f41c0c0-4368-437b-b42e-521b2de3066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:49.086379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 675/1339] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:30:49.387101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4554c-3292-41e7-acff-e6e864125ba9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:49.388656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2fb4554c-3292-41e7-acff-e6e864125ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:49.487486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:49.527512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4554c-3292-41e7-acff-e6e864125ba9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:49.670726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c600640-e554-4244-bd9f-e3580b72bc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:49.671719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600640-e554-4244-bd9f-e3580b72bc02 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:49.672226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600640-e554-4244-bd9f-e3580b72bc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:49.672714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c600640-e554-4244-bd9f-e3580b72bc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:49.676041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0c600640-e554-4244-bd9f-e3580b72bc02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:49.834716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c600640-e554-4244-bd9f-e3580b72bc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:49.836172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c600640-e554-4244-bd9f-e3580b72bc02 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:49.859080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 665/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:30:54.720931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b678b2-bf1d-45c3-b33b-a8b82116b2c6 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:54.721853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b678b2-bf1d-45c3-b33b-a8b82116b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:54.721853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b678b2-bf1d-45c3-b33b-a8b82116b2c6 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:54.722969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 676/1341] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:30:54.729302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb33b-6283-42dc-a5ad-5fa12e601229 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:54.729993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb33b-6283-42dc-a5ad-5fa12e601229 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:54.729993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eb33b-6283-42dc-a5ad-5fa12e601229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:54.735952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:54.818803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1f5eb33b-6283-42dc-a5ad-5fa12e601229 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:54.820393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1f5eb33b-6283-42dc-a5ad-5fa12e601229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:54.986930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 666/1342] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:30:55.343405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b678b2-bf1d-45c3-b33b-a8b82116b2c6 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:55.345201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-13b678b2-bf1d-45c3-b33b-a8b82116b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:55.409730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:55.492346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b678b2-bf1d-45c3-b33b-a8b82116b2c6 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:55.587741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e3fe2-9eeb-47ba-b720-338ef69f77fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:55.588410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e3fe2-9eeb-47ba-b720-338ef69f77fe service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:55.588755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e3fe2-9eeb-47ba-b720-338ef69f77fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:55.589228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e3fe2-9eeb-47ba-b720-338ef69f77fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:55.592565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-095e3fe2-9eeb-47ba-b720-338ef69f77fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:55.729025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:55.763504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e3fe2-9eeb-47ba-b720-338ef69f77fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:30:55.767014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e3fe2-9eeb-47ba-b720-338ef69f77fe service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:30:55.806822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 677/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:30:59.051814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0e4a-77db-4b7e-b956-544fd2dad2a6 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:59.052682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0e4a-77db-4b7e-b956-544fd2dad2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:59.052682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d0e4a-77db-4b7e-b956-544fd2dad2a6 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:59.053771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 667/1344] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:30:59.060650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b15ac-f2e0-438d-a952-01793a54e6c1 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:59.061240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b15ac-f2e0-438d-a952-01793a54e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:59.061747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b15ac-f2e0-438d-a952-01793a54e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:59.166322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1f0b15ac-f2e0-438d-a952-01793a54e6c1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:30:59.167647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1f0b15ac-f2e0-438d-a952-01793a54e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:59.309591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 678/1345] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:30:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:30:59.604155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d0e4a-77db-4b7e-b956-544fd2dad2a6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:30:59.606812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ab7d0e4a-77db-4b7e-b956-544fd2dad2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:30:59.758073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:30:59.783749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d0e4a-77db-4b7e-b956-544fd2dad2a6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:30:59.880775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a4e13-ff32-49b5-a9ae-d9cafe11d86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:30:59.881584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a4e13-ff32-49b5-a9ae-d9cafe11d86a service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:30:59.882000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a4e13-ff32-49b5-a9ae-d9cafe11d86a service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:30:59.882366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a4e13-ff32-49b5-a9ae-d9cafe11d86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:30:59.884603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7a5a4e13-ff32-49b5-a9ae-d9cafe11d86a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:00.048153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a4e13-ff32-49b5-a9ae-d9cafe11d86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:00.049673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a4e13-ff32-49b5-a9ae-d9cafe11d86a service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:00.071347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 668/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:30:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:31:04.994090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270965-7b64-4603-ab40-c6a00086119f None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:04.994768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270965-7b64-4603-ab40-c6a00086119f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:04.994768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270965-7b64-4603-ab40-c6a00086119f None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:04.996390 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 679/1347] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:31:05.002936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21379e-a5d9-4054-a8be-bd62be18394a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:05.003752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21379e-a5d9-4054-a8be-bd62be18394a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:05.003752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21379e-a5d9-4054-a8be-bd62be18394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:05.022102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:05.105871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8f21379e-a5d9-4054-a8be-bd62be18394a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:05.108108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8f21379e-a5d9-4054-a8be-bd62be18394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:05.268690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 669/1348] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:31:05.560282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a270965-7b64-4603-ab40-c6a00086119f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:05.562878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5a270965-7b64-4603-ab40-c6a00086119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:05.647543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:05.721940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a270965-7b64-4603-ab40-c6a00086119f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:05.815957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c31ed-d905-48f2-96fd-442ef8b3c7b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:05.816589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c31ed-d905-48f2-96fd-442ef8b3c7b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:05.816872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c31ed-d905-48f2-96fd-442ef8b3c7b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:05.817146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c31ed-d905-48f2-96fd-442ef8b3c7b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:05.818947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-666c31ed-d905-48f2-96fd-442ef8b3c7b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:05.976558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:05.982280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c31ed-d905-48f2-96fd-442ef8b3c7b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:05.983898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c31ed-d905-48f2-96fd-442ef8b3c7b7 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:06.005796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 680/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:12.166221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db646-0285-4b06-bbd5-bbabe2176e3c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:12.166748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db646-0285-4b06-bbd5-bbabe2176e3c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:12.167182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db646-0285-4b06-bbd5-bbabe2176e3c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:12.170692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 670/1350] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:31:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:12.179135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138087a1-8360-465b-a633-bb6b115a08b9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:12.179793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138087a1-8360-465b-a633-bb6b115a08b9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:12.179793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138087a1-8360-465b-a633-bb6b115a08b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:12.337268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-138087a1-8360-465b-a633-bb6b115a08b9 None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:12.339680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-138087a1-8360-465b-a633-bb6b115a08b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:12.607035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 681/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:15.266366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=59 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:18.137580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609625ad-d6c5-4118-b692-fa4cd10ea6e6 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:18.138577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609625ad-d6c5-4118-b692-fa4cd10ea6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:18.138577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609625ad-d6c5-4118-b692-fa4cd10ea6e6 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:18.140817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 671/1352] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:31:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:18.149792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7edb5-8f23-454e-8b15-f6dbca16e0da None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:18.150650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7edb5-8f23-454e-8b15-f6dbca16e0da None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:18.151268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7edb5-8f23-454e-8b15-f6dbca16e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:18.271789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:18.316021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-fac7edb5-8f23-454e-8b15-f6dbca16e0da None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:18.317528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-fac7edb5-8f23-454e-8b15-f6dbca16e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:18.480416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 682/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:20.371253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538b4c-705a-4af8-8a55-0364e9359f07 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:20.372096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538b4c-705a-4af8-8a55-0364e9359f07 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:20.372096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0538b4c-705a-4af8-8a55-0364e9359f07 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:20.373153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 672/1354] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:31:20.379431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1373-2782-4369-bcab-619e2f3a3429 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:20.380249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1373-2782-4369-bcab-619e2f3a3429 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:20.380413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb1373-2782-4369-bcab-619e2f3a3429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:20.494175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-65eb1373-2782-4369-bcab-619e2f3a3429 None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:20.495471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-65eb1373-2782-4369-bcab-619e2f3a3429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:20.558657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:20.663721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 683/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:24.204607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a04de5-3f1c-4749-84b8-4ae3443b0189 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:24.205745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a04de5-3f1c-4749-84b8-4ae3443b0189 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:24.205745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a04de5-3f1c-4749-84b8-4ae3443b0189 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:24.208267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 673/1356] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:24.216463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7ff07-60d0-4a93-83af-083c40981b00 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:24.217730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7ff07-60d0-4a93-83af-083c40981b00 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:24.218056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7ff07-60d0-4a93-83af-083c40981b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:24.328865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5fd7ff07-60d0-4a93-83af-083c40981b00 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:24.330226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5fd7ff07-60d0-4a93-83af-083c40981b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:24.520165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 684/1357] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:24.831126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491b7d3-5508-4f13-88e0-015c310d0c53 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:24.831660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491b7d3-5508-4f13-88e0-015c310d0c53 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:24.832090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491b7d3-5508-4f13-88e0-015c310d0c53 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:24.835010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 674/1358] 10.222.0.17 () {54 vars in 961 bytes} [Mon Oct 3 12:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:31:24.846107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ecaa7-ea03-48e4-abba-44f398474734 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:24.846565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ecaa7-ea03-48e4-abba-44f398474734 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:24.847069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ecaa7-ea03-48e4-abba-44f398474734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:24.876932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:25.009454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-fd5ecaa7-ea03-48e4-abba-44f398474734 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:25.012599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-fd5ecaa7-ea03-48e4-abba-44f398474734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:25.199295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 685/1359] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Oct 3 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:25.212992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491b7d3-5508-4f13-88e0-015c310d0c53 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:25.214764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a491b7d3-5508-4f13-88e0-015c310d0c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:25.390645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491b7d3-5508-4f13-88e0-015c310d0c53 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:25.480843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:25.533156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f36cd0-efbf-4c80-bd73-1994f204c468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:25.533929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f36cd0-efbf-4c80-bd73-1994f204c468 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:25.534209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f36cd0-efbf-4c80-bd73-1994f204c468 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:25.534483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f36cd0-efbf-4c80-bd73-1994f204c468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:25.536149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d1f36cd0-efbf-4c80-bd73-1994f204c468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:25.671536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f36cd0-efbf-4c80-bd73-1994f204c468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:25.673326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f36cd0-efbf-4c80-bd73-1994f204c468 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:25.707246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 675/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:28.851158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ac2e-b0ae-43f8-9be8-da39d30d7aec None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:28.851953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ac2e-b0ae-43f8-9be8-da39d30d7aec None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:28.851953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ac2e-b0ae-43f8-9be8-da39d30d7aec None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:28.853565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 686/1361] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:28.860685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ba4d-ed21-46c1-8213-0f5f8a017d3d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:28.861226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ba4d-ed21-46c1-8213-0f5f8a017d3d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:28.861609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96ba4d-ed21-46c1-8213-0f5f8a017d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:28.971930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-be96ba4d-ed21-46c1-8213-0f5f8a017d3d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:28.973556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-be96ba4d-ed21-46c1-8213-0f5f8a017d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:29.030921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:29.117011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 676/1362] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:29.424464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61ac2e-b0ae-43f8-9be8-da39d30d7aec None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:29.427677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7c61ac2e-b0ae-43f8-9be8-da39d30d7aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:29.529835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:29.655033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61ac2e-b0ae-43f8-9be8-da39d30d7aec None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:29.837183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6884954-de2a-43b5-89cd-5bdc3b9d3f39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:29.838010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884954-de2a-43b5-89cd-5bdc3b9d3f39 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:29.838299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884954-de2a-43b5-89cd-5bdc3b9d3f39 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:29.838576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884954-de2a-43b5-89cd-5bdc3b9d3f39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:29.840410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c6884954-de2a-43b5-89cd-5bdc3b9d3f39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:29.871301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:29.988358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6884954-de2a-43b5-89cd-5bdc3b9d3f39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:29.990510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6884954-de2a-43b5-89cd-5bdc3b9d3f39 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:30.017369 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 687/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:31:33.017237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbabafb-952b-4481-9948-096bc9b5683c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:33.018121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbabafb-952b-4481-9948-096bc9b5683c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:33.018121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbabafb-952b-4481-9948-096bc9b5683c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:33.019584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 677/1364] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:31:33.025967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894b81-4bbc-4217-8621-9e909bb0cae4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:33.026825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894b81-4bbc-4217-8621-9e909bb0cae4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:33.026825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894b81-4bbc-4217-8621-9e909bb0cae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:33.109384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-88894b81-4bbc-4217-8621-9e909bb0cae4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:33.110691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-88894b81-4bbc-4217-8621-9e909bb0cae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:33.234816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:33.240029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 688/1365] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:31:33.546209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3aa00-7a48-440f-9082-f7573412e9b4 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:33.546845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3aa00-7a48-440f-9082-f7573412e9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:33.547345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3aa00-7a48-440f-9082-f7573412e9b4 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:33.549217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 678/1366] 10.222.0.17 () {54 vars in 961 bytes} [Mon Oct 3 12:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:33.558699 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e9312-8d0e-405b-abf4-928fe57e8ef0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:33.559059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e9312-8d0e-405b-abf4-928fe57e8ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:33.559247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e9312-8d0e-405b-abf4-928fe57e8ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:33.660839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-d06e9312-8d0e-405b-abf4-928fe57e8ef0 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:33.662209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d06e9312-8d0e-405b-abf4-928fe57e8ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:33.835659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 689/1367] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Oct 3 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:33.851501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3aa00-7a48-440f-9082-f7573412e9b4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:33.855089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-26b3aa00-7a48-440f-9082-f7573412e9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:34.168392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3aa00-7a48-440f-9082-f7573412e9b4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:34.211107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:34.427686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da81ce2-b638-4738-a420-6f4516021e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:34.429159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81ce2-b638-4738-a420-6f4516021e0a service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:34.429850 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81ce2-b638-4738-a420-6f4516021e0a service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:34.430454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da81ce2-b638-4738-a420-6f4516021e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:34.433921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5da81ce2-b638-4738-a420-6f4516021e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:34.593003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da81ce2-b638-4738-a420-6f4516021e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:34.594892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da81ce2-b638-4738-a420-6f4516021e0a service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:34.618621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 679/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 768 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:35.365416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962b0b-0565-4ccb-aaf4-20ff4a12073f None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:35.366241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962b0b-0565-4ccb-aaf4-20ff4a12073f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:35.366241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06962b0b-0565-4ccb-aaf4-20ff4a12073f None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:35.374036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb68f-2aae-4a7d-b374-43a431dd9dcf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:35.374836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb68f-2aae-4a7d-b374-43a431dd9dcf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:35.374836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb68f-2aae-4a7d-b374-43a431dd9dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:35.379662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 690/1369] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:35 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:35.430177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:35.469566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6bbbb68f-2aae-4a7d-b374-43a431dd9dcf None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:35.471777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6bbbb68f-2aae-4a7d-b374-43a431dd9dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:35.656324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 680/1370] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:36.221553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e844a-273f-4f0b-92c3-da893b6b9240 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:36.221553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e844a-273f-4f0b-92c3-da893b6b9240 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:36.221553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e844a-273f-4f0b-92c3-da893b6b9240 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:36.221553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 691/1371] 10.222.0.17 () {54 vars in 963 bytes} [Mon Oct 3 12:31:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:36.232037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac5e5-e7d7-43bf-a273-c6bad0d7b822 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:36.232037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac5e5-e7d7-43bf-a273-c6bad0d7b822 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:36.232037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ac5e5-e7d7-43bf-a273-c6bad0d7b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:36.404376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-646ac5e5-e7d7-43bf-a273-c6bad0d7b822 None None] MFA Rules not processed for user `1e81eb41d8264474917e3b4f3fa2becd`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:36.406646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-646ac5e5-e7d7-43bf-a273-c6bad0d7b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:36.486751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:36.540982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 681/1372] 10.222.0.17 () {58 vars in 1060 bytes} [Mon Oct 3 12:31:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:36.550490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e844a-273f-4f0b-92c3-da893b6b9240 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:36.552263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-cb3e844a-273f-4f0b-92c3-da893b6b9240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:36.617277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:36.723410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e844a-273f-4f0b-92c3-da893b6b9240 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:36.824977 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058ff91-b36b-4915-b6f1-32525fe4fd1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:36.825639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ff91-b36b-4915-b6f1-32525fe4fd1d service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:36.825998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ff91-b36b-4915-b6f1-32525fe4fd1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:36.826371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058ff91-b36b-4915-b6f1-32525fe4fd1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:36.828283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a058ff91-b36b-4915-b6f1-32525fe4fd1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:36.972409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:37.007966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ff91-b36b-4915-b6f1-32525fe4fd1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:37.011155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058ff91-b36b-4915-b6f1-32525fe4fd1d service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:37.048539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 692/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:37.684010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbded0-0694-4874-8a6a-263fd33b3bd7 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:37.684691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbded0-0694-4874-8a6a-263fd33b3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:37.684691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbded0-0694-4874-8a6a-263fd33b3bd7 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:37.685987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 682/1374] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:37.692246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea253b6-798e-4cff-b5c6-c9162dd7d2ea None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:37.693034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea253b6-798e-4cff-b5c6-c9162dd7d2ea None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:37.693034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea253b6-798e-4cff-b5c6-c9162dd7d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:37.775291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8ea253b6-798e-4cff-b5c6-c9162dd7d2ea None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:37.776649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8ea253b6-798e-4cff-b5c6-c9162dd7d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:37.887866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 693/1375] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:31:38.191435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbded0-0694-4874-8a6a-263fd33b3bd7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:38.194503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-04bbded0-0694-4874-8a6a-263fd33b3bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:38.443201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbded0-0694-4874-8a6a-263fd33b3bd7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:38.522915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:38.635032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdad1cf-0084-4dd5-88df-b5a1c3e4763d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:38.635834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad1cf-0084-4dd5-88df-b5a1c3e4763d service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:38.636221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad1cf-0084-4dd5-88df-b5a1c3e4763d service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:38.636586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdad1cf-0084-4dd5-88df-b5a1c3e4763d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:38.638682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9bdad1cf-0084-4dd5-88df-b5a1c3e4763d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:38.792224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdad1cf-0084-4dd5-88df-b5a1c3e4763d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:38.793999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdad1cf-0084-4dd5-88df-b5a1c3e4763d service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:38.816458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 683/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:41.300113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187dc38-1ee5-4f3a-9892-2e2005bba830 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:41.301638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187dc38-1ee5-4f3a-9892-2e2005bba830 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:41.302325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187dc38-1ee5-4f3a-9892-2e2005bba830 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:41.306593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 694/1377] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:31:41.312719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4a70-ddfc-4985-a6d5-1c8786b04379 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:41.313553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4a70-ddfc-4985-a6d5-1c8786b04379 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:41.313553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe4a70-ddfc-4985-a6d5-1c8786b04379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:41.467961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-affe4a70-ddfc-4985-a6d5-1c8786b04379 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:41.470637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-affe4a70-ddfc-4985-a6d5-1c8786b04379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:41.488965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:41.624350 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 684/1378] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:31:42.177863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187dc38-1ee5-4f3a-9892-2e2005bba830 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:42.180864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b187dc38-1ee5-4f3a-9892-2e2005bba830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:42.307484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:42.480121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187dc38-1ee5-4f3a-9892-2e2005bba830 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:42.653948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60e942-2b06-4dae-b761-d874fde40d12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:42.653948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60e942-2b06-4dae-b761-d874fde40d12 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:42.654461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60e942-2b06-4dae-b761-d874fde40d12 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:42.654461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60e942-2b06-4dae-b761-d874fde40d12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:42.656136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-bf60e942-2b06-4dae-b761-d874fde40d12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:42.680214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:42.777303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60e942-2b06-4dae-b761-d874fde40d12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:42.779449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60e942-2b06-4dae-b761-d874fde40d12 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:42.800822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 695/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:45.533161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e34f-3c03-4dd2-ad0a-e636e737a7ba None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:45.534005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e34f-3c03-4dd2-ad0a-e636e737a7ba None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:45.534005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e34f-3c03-4dd2-ad0a-e636e737a7ba None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:45.536156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 685/1380] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:45.545631 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8a2f-1d81-481b-bf16-dc596cf9b395 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:45.546493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8a2f-1d81-481b-bf16-dc596cf9b395 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:45.546493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b8a2f-1d81-481b-bf16-dc596cf9b395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:45.685330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f31b8a2f-1d81-481b-bf16-dc596cf9b395 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:45.687847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f31b8a2f-1d81-481b-bf16-dc596cf9b395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:45.882707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:45.895862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 696/1381] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:46.265705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980e34f-3c03-4dd2-ad0a-e636e737a7ba None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:46.268910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4980e34f-3c03-4dd2-ad0a-e636e737a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:46.572214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:46.589727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980e34f-3c03-4dd2-ad0a-e636e737a7ba None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:46.796645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3ea53-7be9-4492-a560-4b74e5f88443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:46.797311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ea53-7be9-4492-a560-4b74e5f88443 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:46.797624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ea53-7be9-4492-a560-4b74e5f88443 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:46.797996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3ea53-7be9-4492-a560-4b74e5f88443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:46.799768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5eb3ea53-7be9-4492-a560-4b74e5f88443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:46.958323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3ea53-7be9-4492-a560-4b74e5f88443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:46.960710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3ea53-7be9-4492-a560-4b74e5f88443 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:46.975420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:46.993309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 686/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:49.614888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d399b2-15cf-4194-9f7f-e34a06ea84ab None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:49.615640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d399b2-15cf-4194-9f7f-e34a06ea84ab None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:49.615640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d399b2-15cf-4194-9f7f-e34a06ea84ab None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:49.616904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 697/1383] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:49.624080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc22fc8-48ed-4c03-a78f-a519064de8d2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:49.624657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc22fc8-48ed-4c03-a78f-a519064de8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:49.624925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc22fc8-48ed-4c03-a78f-a519064de8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:49.711176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9dc22fc8-48ed-4c03-a78f-a519064de8d2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:49.712479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9dc22fc8-48ed-4c03-a78f-a519064de8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:49.868812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 687/1384] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:31:50.163712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d399b2-15cf-4194-9f7f-e34a06ea84ab None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:50.165274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-75d399b2-15cf-4194-9f7f-e34a06ea84ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:50.362932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d399b2-15cf-4194-9f7f-e34a06ea84ab None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:50.446501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:50.506013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2cb8-e5bb-4699-bae2-1d3229e0c411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:50.506825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2cb8-e5bb-4699-bae2-1d3229e0c411 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:50.507204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2cb8-e5bb-4699-bae2-1d3229e0c411 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:50.507557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2cb8-e5bb-4699-bae2-1d3229e0c411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:50.509505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a14e2cb8-e5bb-4699-bae2-1d3229e0c411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:50.624565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2cb8-e5bb-4699-bae2-1d3229e0c411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:50.626257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2cb8-e5bb-4699-bae2-1d3229e0c411 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:50.648701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 698/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:53.046663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ba2d-5f60-4152-9d48-57c4eaa6ecfb None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:53.047533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ba2d-5f60-4152-9d48-57c4eaa6ecfb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:53.047533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0ba2d-5f60-4152-9d48-57c4eaa6ecfb None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:53.048613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 688/1386] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:31:53.057168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea1ed-2d55-40c9-9d81-a4ba95e70fa5 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:53.057846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea1ed-2d55-40c9-9d81-a4ba95e70fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:53.057846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea1ed-2d55-40c9-9d81-a4ba95e70fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:53.139945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3edea1ed-2d55-40c9-9d81-a4ba95e70fa5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:53.141209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3edea1ed-2d55-40c9-9d81-a4ba95e70fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:53.179847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:53.279349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 699/1387] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:53.581824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ba2d-5f60-4152-9d48-57c4eaa6ecfb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:53.583630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-05d0ba2d-5f60-4152-9d48-57c4eaa6ecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:53.711101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:53.814016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0ba2d-5f60-4152-9d48-57c4eaa6ecfb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:53.988761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58119d23-43cd-4b25-8196-777039abe066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:53.989607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119d23-43cd-4b25-8196-777039abe066 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:53.989998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119d23-43cd-4b25-8196-777039abe066 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:53.990370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58119d23-43cd-4b25-8196-777039abe066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:53.992317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-58119d23-43cd-4b25-8196-777039abe066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:54.047650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:54.132162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58119d23-43cd-4b25-8196-777039abe066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:54.135583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58119d23-43cd-4b25-8196-777039abe066 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:54.166957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 689/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:54.403922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3de41-f664-4947-8cde-876ab07fb61c None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:54.404582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3de41-f664-4947-8cde-876ab07fb61c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:54.404892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3de41-f664-4947-8cde-876ab07fb61c None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:54.407955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 700/1389] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:54.414363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858003-ec4a-4422-8281-a14649c2f05d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:54.414823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858003-ec4a-4422-8281-a14649c2f05d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:54.415220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02858003-ec4a-4422-8281-a14649c2f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:54.514038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-02858003-ec4a-4422-8281-a14649c2f05d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:54.516062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-02858003-ec4a-4422-8281-a14649c2f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:54.654953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 690/1390] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:54.976910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f659894-7cc2-4aca-874a-07a729e24a46 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:54.977426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f659894-7cc2-4aca-874a-07a729e24a46 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:54.977975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f659894-7cc2-4aca-874a-07a729e24a46 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:54.980561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 701/1391] 10.222.0.17 () {54 vars in 962 bytes} [Mon Oct 3 12:31:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:54.990138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86194-c834-48a2-a16c-ec4268617619 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:54.990442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86194-c834-48a2-a16c-ec4268617619 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:54.990727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86194-c834-48a2-a16c-ec4268617619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:55.019801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:55.143397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ddd86194-c834-48a2-a16c-ec4268617619 None None] MFA Rules not processed for user `d676c76b05924c4ab06940f04996fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:55.145646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ddd86194-c834-48a2-a16c-ec4268617619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:55.299528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 691/1392] 10.222.0.17 () {58 vars in 1059 bytes} [Mon Oct 3 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:55.310585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f659894-7cc2-4aca-874a-07a729e24a46 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:55.312297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6f659894-7cc2-4aca-874a-07a729e24a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:55.489272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f659894-7cc2-4aca-874a-07a729e24a46 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:55.581054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:55.603087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526caea0-5a6e-46e2-ac87-4f03ed32ef24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:55.603881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526caea0-5a6e-46e2-ac87-4f03ed32ef24 service glance] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:55.604292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526caea0-5a6e-46e2-ac87-4f03ed32ef24 service glance] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:55.604704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526caea0-5a6e-46e2-ac87-4f03ed32ef24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:55.606823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-526caea0-5a6e-46e2-ac87-4f03ed32ef24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:55.778883 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526caea0-5a6e-46e2-ac87-4f03ed32ef24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:55.780775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526caea0-5a6e-46e2-ac87-4f03ed32ef24 service glance] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:55.808403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 702/1393] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:31:56.655351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324af9d-71e1-45b1-a301-a49bb0f5e688 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:56.656170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324af9d-71e1-45b1-a301-a49bb0f5e688 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:56.656385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324af9d-71e1-45b1-a301-a49bb0f5e688 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:56.659327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 692/1394] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:31:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:56.668166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f31e3-b574-4f8d-9ddc-4e402aba059d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:56.669017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f31e3-b574-4f8d-9ddc-4e402aba059d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:56.669178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f31e3-b574-4f8d-9ddc-4e402aba059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:56.669340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cb69-03bf-4b18-9d9d-d7f4b241e1c6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:56.669629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cb69-03bf-4b18-9d9d-d7f4b241e1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:56.670043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cb69-03bf-4b18-9d9d-d7f4b241e1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:56.756038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-254f31e3-b574-4f8d-9ddc-4e402aba059d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:56.757288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-254f31e3-b574-4f8d-9ddc-4e402aba059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:56.776396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d351cb69-03bf-4b18-9d9d-d7f4b241e1c6 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:56.777700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d351cb69-03bf-4b18-9d9d-d7f4b241e1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:56.824440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:56.849860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:56.890855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 693/1395] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:31:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:31:56.899892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 703/1396] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:56.941024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b609d7-7e5e-481c-88e1-915bcb1a3486 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:56.941539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b609d7-7e5e-481c-88e1-915bcb1a3486 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:56.941963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b609d7-7e5e-481c-88e1-915bcb1a3486 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:56.943660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 694/1397] 10.222.0.17 () {54 vars in 943 bytes} [Mon Oct 3 12:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:31:56.950860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1c0f1-f80c-4261-b14a-670adc8d842c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:56.951282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1c0f1-f80c-4261-b14a-670adc8d842c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:56.951630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1c0f1-f80c-4261-b14a-670adc8d842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:57.045780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5be1c0f1-f80c-4261-b14a-670adc8d842c None None] MFA Rules not processed for user `f15a3709dbdf43efab86e3bed4977095`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:31:57.047551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5be1c0f1-f80c-4261-b14a-670adc8d842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:57.203281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b609d7-7e5e-481c-88e1-915bcb1a3486 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:57.204813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-95b609d7-7e5e-481c-88e1-915bcb1a3486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:57.223839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 704/1398] 10.222.0.17 () {58 vars in 1040 bytes} [Mon Oct 3 12:31:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:31:57.239225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1c0f1-f80c-4261-b14a-670adc8d842c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:31:57.247097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:57.257962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1c0f1-f80c-4261-b14a-670adc8d842c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:57.395574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b609d7-7e5e-481c-88e1-915bcb1a3486 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:31:57.467309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:31:57.543888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c526d35-0c2c-40cc-9349-854a5ddf1861 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:57.544529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526d35-0c2c-40cc-9349-854a5ddf1861 service swift] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:57.544806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526d35-0c2c-40cc-9349-854a5ddf1861 service swift] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:57.545120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c526d35-0c2c-40cc-9349-854a5ddf1861 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:57.547079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4c526d35-0c2c-40cc-9349-854a5ddf1861 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:57.557809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81e634-d3f3-4bc4-9b75-4edb3a1cbc41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:31:57.558444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81e634-d3f3-4bc4-9b75-4edb3a1cbc41 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:31:57.558728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81e634-d3f3-4bc4-9b75-4edb3a1cbc41 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:31:57.559004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81e634-d3f3-4bc4-9b75-4edb3a1cbc41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:31:57.562033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1f81e634-d3f3-4bc4-9b75-4edb3a1cbc41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:31:57.652156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c526d35-0c2c-40cc-9349-854a5ddf1861 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:57.653904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c526d35-0c2c-40cc-9349-854a5ddf1861 service swift] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:57.663769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 705/1399] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:31:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 12:31:57.668703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81e634-d3f3-4bc4-9b75-4edb3a1cbc41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:31:57.670465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81e634-d3f3-4bc4-9b75-4edb3a1cbc41 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:31:57.693869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 695/1400] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:32:00.209174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1e78-0be6-435d-a0d9-816f7cdfdbe5 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:00.209878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1e78-0be6-435d-a0d9-816f7cdfdbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:00.209878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1e78-0be6-435d-a0d9-816f7cdfdbe5 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:00.211333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 706/1401] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:00.217484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387112f8-9175-40c3-811f-80bdc61d9479 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:00.218140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387112f8-9175-40c3-811f-80bdc61d9479 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:00.218140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387112f8-9175-40c3-811f-80bdc61d9479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:00.345035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-387112f8-9175-40c3-811f-80bdc61d9479 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:00.346344 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-387112f8-9175-40c3-811f-80bdc61d9479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:00.355628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:00.484547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 696/1402] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:32:00.847140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a1e78-0be6-435d-a0d9-816f7cdfdbe5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:00.848842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-067a1e78-0be6-435d-a0d9-816f7cdfdbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:00.895761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:01.116263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a1e78-0be6-435d-a0d9-816f7cdfdbe5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:01.293213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:01.309779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc9a7c-7d9c-4000-ab39-c9a2dc561a45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:01.310429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9a7c-7d9c-4000-ab39-c9a2dc561a45 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:01.310706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9a7c-7d9c-4000-ab39-c9a2dc561a45 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:01.310985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc9a7c-7d9c-4000-ab39-c9a2dc561a45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:01.312694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6bfc9a7c-7d9c-4000-ab39-c9a2dc561a45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:01.439325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc9a7c-7d9c-4000-ab39-c9a2dc561a45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:01.441143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc9a7c-7d9c-4000-ab39-c9a2dc561a45 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:01.465806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 707/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:32:04.108536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf3e9-ea3d-4142-b038-4dcb28065170 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:04.109399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf3e9-ea3d-4142-b038-4dcb28065170 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:04.109399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bf3e9-ea3d-4142-b038-4dcb28065170 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:04.112483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 697/1404] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:32:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:04.118338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e37a32-6087-4bfe-93a1-1a0fba639774 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:04.119036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e37a32-6087-4bfe-93a1-1a0fba639774 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:04.119036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e37a32-6087-4bfe-93a1-1a0fba639774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:04.222840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-76e37a32-6087-4bfe-93a1-1a0fba639774 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:04.225025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-76e37a32-6087-4bfe-93a1-1a0fba639774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:04.344464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:04.414248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 708/1405] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:32:04.978601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bf3e9-ea3d-4142-b038-4dcb28065170 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:04.980808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ea6bf3e9-ea3d-4142-b038-4dcb28065170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:05.222378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:05.242864 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bf3e9-ea3d-4142-b038-4dcb28065170 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:05.507030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fc54d-05f4-47d9-8d0c-e99fef649e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:05.507996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc54d-05f4-47d9-8d0c-e99fef649e2b service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:05.508759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc54d-05f4-47d9-8d0c-e99fef649e2b service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:05.509250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc54d-05f4-47d9-8d0c-e99fef649e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:05.512341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7e8fc54d-05f4-47d9-8d0c-e99fef649e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:05.751056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fc54d-05f4-47d9-8d0c-e99fef649e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:05.753203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fc54d-05f4-47d9-8d0c-e99fef649e2b service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:05.768112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:05.801749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 698/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 823 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:32:08.364507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d71f5-6054-46b1-abdb-1add58336d47 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:08.365101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d71f5-6054-46b1-abdb-1add58336d47 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:08.365889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d71f5-6054-46b1-abdb-1add58336d47 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:08.369573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 709/1407] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:32:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:32:08.374750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04612b-a2f5-4f14-9f25-c99c1d0d4d75 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:08.375313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04612b-a2f5-4f14-9f25-c99c1d0d4d75 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:08.375313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04612b-a2f5-4f14-9f25-c99c1d0d4d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:08.466478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6c04612b-a2f5-4f14-9f25-c99c1d0d4d75 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:08.468078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6c04612b-a2f5-4f14-9f25-c99c1d0d4d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:08.632712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 699/1408] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:09.204026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d71f5-6054-46b1-abdb-1add58336d47 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:09.206272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-129d71f5-6054-46b1-abdb-1add58336d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:09.468926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d71f5-6054-46b1-abdb-1add58336d47 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:09.580296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:09.710300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ffee8-4d90-46bb-9b59-5141fe87c508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:09.711039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ffee8-4d90-46bb-9b59-5141fe87c508 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:09.711477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ffee8-4d90-46bb-9b59-5141fe87c508 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:09.711756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ffee8-4d90-46bb-9b59-5141fe87c508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:09.713739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0e8ffee8-4d90-46bb-9b59-5141fe87c508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:09.850143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ffee8-4d90-46bb-9b59-5141fe87c508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:09.851856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ffee8-4d90-46bb-9b59-5141fe87c508 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:09.879819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 710/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:18.631254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=67 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:19.876215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=76 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:22.720546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0228d-e93f-4234-85ab-14f098d45421 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:22.721165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0228d-e93f-4234-85ab-14f098d45421 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:22.721165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0228d-e93f-4234-85ab-14f098d45421 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:22.722600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 700/1410] 10.222.0.17 () {54 vars in 918 bytes} [Mon Oct 3 12:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:22.729951 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd60ad-fee3-459a-9c2b-419b7f799e49 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:22.730594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd60ad-fee3-459a-9c2b-419b7f799e49 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:22.730885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd60ad-fee3-459a-9c2b-419b7f799e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:22.863424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a9fd60ad-fee3-459a-9c2b-419b7f799e49 None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:22.864945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a9fd60ad-fee3-459a-9c2b-419b7f799e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:23.003642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 711/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Oct 3 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:23.019547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36e38-93a4-470e-a936-42b580df3f79 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:23.020413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36e38-93a4-470e-a936-42b580df3f79 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:23.020629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec36e38-93a4-470e-a936-42b580df3f79 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:23.022058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 701/1412] 10.222.0.17 () {54 vars in 918 bytes} [Mon Oct 3 12:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:23.028879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae2e5-120b-4641-be5e-5268e4b3c508 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:23.029300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae2e5-120b-4641-be5e-5268e4b3c508 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:23.029725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae2e5-120b-4641-be5e-5268e4b3c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:23.134878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:23.138213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e62ae2e5-120b-4641-be5e-5268e4b3c508 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:23.140365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e62ae2e5-120b-4641-be5e-5268e4b3c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:23.283867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 712/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Oct 3 12:32:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:26.077685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94100800-8666-4581-b04f-176cc6b499e5 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:26.078418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94100800-8666-4581-b04f-176cc6b499e5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:26.078418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94100800-8666-4581-b04f-176cc6b499e5 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:26.079738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:26.085724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007619b-5cc5-4b77-916f-18f97d2f9cdc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:26.086537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007619b-5cc5-4b77-916f-18f97d2f9cdc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:26.086537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007619b-5cc5-4b77-916f-18f97d2f9cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:26.169169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2007619b-5cc5-4b77-916f-18f97d2f9cdc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:26.170458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2007619b-5cc5-4b77-916f-18f97d2f9cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:26.236613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:26.291926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:32:26.835773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94100800-8666-4581-b04f-176cc6b499e5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:26.837623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-94100800-8666-4581-b04f-176cc6b499e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:27.030594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94100800-8666-4581-b04f-176cc6b499e5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:27.118697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:27.177457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2341b14-c7c4-458d-9469-c0e442c10fe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:27.178125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341b14-c7c4-458d-9469-c0e442c10fe7 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:27.178404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341b14-c7c4-458d-9469-c0e442c10fe7 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:27.178684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2341b14-c7c4-458d-9469-c0e442c10fe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:27.180428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f2341b14-c7c4-458d-9469-c0e442c10fe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:27.288463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2341b14-c7c4-458d-9469-c0e442c10fe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:27.290074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2341b14-c7c4-458d-9469-c0e442c10fe7 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:27.310875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 703/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:28.566223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ce2de-7d47-4247-b723-1406294230b4 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:28.566908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ce2de-7d47-4247-b723-1406294230b4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:28.566908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ce2de-7d47-4247-b723-1406294230b4 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:28.568455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:28.575768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697974dc-6151-4f2d-a27c-0f69bf296402 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:28.576360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697974dc-6151-4f2d-a27c-0f69bf296402 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:28.576360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697974dc-6151-4f2d-a27c-0f69bf296402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:28.666678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-697974dc-6151-4f2d-a27c-0f69bf296402 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:28.668172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-697974dc-6151-4f2d-a27c-0f69bf296402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:28.705256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:28.829296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:32:28.989542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ce2de-7d47-4247-b723-1406294230b4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:28.991195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-946ce2de-7d47-4247-b723-1406294230b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:29.196424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ce2de-7d47-4247-b723-1406294230b4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:29.247777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:29.346684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66e64e-a6cf-4f35-b8b1-07e07cb09e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:29.347311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66e64e-a6cf-4f35-b8b1-07e07cb09e87 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:29.347593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66e64e-a6cf-4f35-b8b1-07e07cb09e87 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:29.347869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66e64e-a6cf-4f35-b8b1-07e07cb09e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:29.349682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5a66e64e-a6cf-4f35-b8b1-07e07cb09e87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:29.461731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66e64e-a6cf-4f35-b8b1-07e07cb09e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:29.463385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66e64e-a6cf-4f35-b8b1-07e07cb09e87 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:29.485478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 715/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:30.781888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1b4eb-fdfe-4a78-91e3-9759c1853bd3 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:30.782508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1b4eb-fdfe-4a78-91e3-9759c1853bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:30.782508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1b4eb-fdfe-4a78-91e3-9759c1853bd3 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:30.783801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:30.790913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c767-230b-4636-b3b5-3c6cedae9dd4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:30.791476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c767-230b-4636-b3b5-3c6cedae9dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:30.791476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c767-230b-4636-b3b5-3c6cedae9dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:30.858874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:30.887569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f829c767-230b-4636-b3b5-3c6cedae9dd4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:30.889044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f829c767-230b-4636-b3b5-3c6cedae9dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:31.007435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:31.169292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1b4eb-fdfe-4a78-91e3-9759c1853bd3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:31.171041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-63e1b4eb-fdfe-4a78-91e3-9759c1853bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:31.352271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1b4eb-fdfe-4a78-91e3-9759c1853bd3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:31.367131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:31.493205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72392-9e0c-4d5f-b24e-48f8a36e2326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:31.494017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72392-9e0c-4d5f-b24e-48f8a36e2326 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:31.494388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72392-9e0c-4d5f-b24e-48f8a36e2326 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:31.494857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72392-9e0c-4d5f-b24e-48f8a36e2326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:31.496892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-61b72392-9e0c-4d5f-b24e-48f8a36e2326 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:31.628794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b72392-9e0c-4d5f-b24e-48f8a36e2326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:31.631318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b72392-9e0c-4d5f-b24e-48f8a36e2326 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:31.652775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 706/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:32.882722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de679f0d-486b-4b65-b8da-4daa354f9cc7 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:32.883608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de679f0d-486b-4b65-b8da-4daa354f9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:32.883773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de679f0d-486b-4b65-b8da-4daa354f9cc7 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:32.885374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:32.892701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02862005-3029-426e-94a3-c71f73e23b7c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:32.893288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02862005-3029-426e-94a3-c71f73e23b7c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:32.893288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02862005-3029-426e-94a3-c71f73e23b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:32.916301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:33.014934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-02862005-3029-426e-94a3-c71f73e23b7c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:33.016473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-02862005-3029-426e-94a3-c71f73e23b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:33.132153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:32:33.290342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de679f0d-486b-4b65-b8da-4daa354f9cc7 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:33.291906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-de679f0d-486b-4b65-b8da-4daa354f9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:33.421705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:33.466797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de679f0d-486b-4b65-b8da-4daa354f9cc7 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:33.612436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9e264-b978-424f-a077-b52396e09cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:33.612966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9e264-b978-424f-a077-b52396e09cda service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:33.613249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9e264-b978-424f-a077-b52396e09cda service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:33.613547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9e264-b978-424f-a077-b52396e09cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:33.615765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e5a9e264-b978-424f-a077-b52396e09cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:33.716375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:33.731750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9e264-b978-424f-a077-b52396e09cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:33.733368 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9e264-b978-424f-a077-b52396e09cda service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:33.755034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 718/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:34.977938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059435-5cc9-4fb2-99ff-61545f10076d None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:34.978488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059435-5cc9-4fb2-99ff-61545f10076d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:34.978488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059435-5cc9-4fb2-99ff-61545f10076d None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:34.980040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:34.987430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9814-5440-4f8b-a176-4ea55be75169 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:34.988081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9814-5440-4f8b-a176-4ea55be75169 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:34.988081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9814-5440-4f8b-a176-4ea55be75169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:35.080770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1d7d9814-5440-4f8b-a176-4ea55be75169 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:35.082302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1d7d9814-5440-4f8b-a176-4ea55be75169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:35.203417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:32:35.360416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad059435-5cc9-4fb2-99ff-61545f10076d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:35.361918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ad059435-5cc9-4fb2-99ff-61545f10076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:35.470535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:35.547783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad059435-5cc9-4fb2-99ff-61545f10076d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:35.679775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055800d-a685-411c-9d54-d1203021054c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:35.680378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055800d-a685-411c-9d54-d1203021054c service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:35.680661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055800d-a685-411c-9d54-d1203021054c service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:35.680943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055800d-a685-411c-9d54-d1203021054c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:35.682797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a055800d-a685-411c-9d54-d1203021054c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:35.757395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:35.804866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055800d-a685-411c-9d54-d1203021054c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:35.806532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055800d-a685-411c-9d54-d1203021054c service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:35.828028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 709/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:36.942510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979fc13-da68-482e-a5c9-ef53b85985f5 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:36.943152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979fc13-da68-482e-a5c9-ef53b85985f5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:36.943430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979fc13-da68-482e-a5c9-ef53b85985f5 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:36.946243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:32:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:36.954439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69965c8b-eeb3-488a-ad0a-219bf8ac643d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:36.955246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69965c8b-eeb3-488a-ad0a-219bf8ac643d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:36.955246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69965c8b-eeb3-488a-ad0a-219bf8ac643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:37.051512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-69965c8b-eeb3-488a-ad0a-219bf8ac643d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:37.052790 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-69965c8b-eeb3-488a-ad0a-219bf8ac643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:37.178622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:37.332715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979fc13-da68-482e-a5c9-ef53b85985f5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:37.334201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6979fc13-da68-482e-a5c9-ef53b85985f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:37.391249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:37.508800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979fc13-da68-482e-a5c9-ef53b85985f5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:37.630378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d812d-779d-44aa-ab5e-5c41ecd108f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:37.630991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d812d-779d-44aa-ab5e-5c41ecd108f0 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:37.631270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d812d-779d-44aa-ab5e-5c41ecd108f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:37.632176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d812d-779d-44aa-ab5e-5c41ecd108f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:37.633982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-514d812d-779d-44aa-ab5e-5c41ecd108f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:37.641914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:37.735410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d812d-779d-44aa-ab5e-5c41ecd108f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:37.737164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d812d-779d-44aa-ab5e-5c41ecd108f0 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:37.758946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 721/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:32:38.912410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4e2c-8478-40b4-92ed-c390fed67681 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:38.913017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4e2c-8478-40b4-92ed-c390fed67681 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:38.913017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4e2c-8478-40b4-92ed-c390fed67681 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:38.914401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:38.921841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddc9e0-0f49-4720-8355-4fa13371978c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:38.922406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddc9e0-0f49-4720-8355-4fa13371978c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:38.922406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddc9e0-0f49-4720-8355-4fa13371978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:39.040775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-56ddc9e0-0f49-4720-8355-4fa13371978c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:39.042074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-56ddc9e0-0f49-4720-8355-4fa13371978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:39.123392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:39.158574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:39.317156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4e2c-8478-40b4-92ed-c390fed67681 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:39.320140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7a4a4e2c-8478-40b4-92ed-c390fed67681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:39.353236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:39.513843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4e2c-8478-40b4-92ed-c390fed67681 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:39.620894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:39.651854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadd661-c5a8-4bc9-87c4-607791ea27d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:39.652493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadd661-c5a8-4bc9-87c4-607791ea27d7 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:39.652840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadd661-c5a8-4bc9-87c4-607791ea27d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:39.653115 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadd661-c5a8-4bc9-87c4-607791ea27d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:39.654890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6eadd661-c5a8-4bc9-87c4-607791ea27d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:39.756865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadd661-c5a8-4bc9-87c4-607791ea27d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:39.758526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadd661-c5a8-4bc9-87c4-607791ea27d7 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:39.779387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 712/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:40.913056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdd46c-fb8f-4ee5-9be6-5c0a54af26fd None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:40.914370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdd46c-fb8f-4ee5-9be6-5c0a54af26fd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:40.914370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdd46c-fb8f-4ee5-9be6-5c0a54af26fd None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:40.915609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:32:40.923098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08dfd-a1d4-4920-bd02-647280354436 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:40.923657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08dfd-a1d4-4920-bd02-647280354436 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:40.923657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08dfd-a1d4-4920-bd02-647280354436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:41.036475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-43d08dfd-a1d4-4920-bd02-647280354436 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:41.037798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-43d08dfd-a1d4-4920-bd02-647280354436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:41.099108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:41.169006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:41.326443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdd46c-fb8f-4ee5-9be6-5c0a54af26fd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:41.328243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-28cdd46c-fb8f-4ee5-9be6-5c0a54af26fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:41.522463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdd46c-fb8f-4ee5-9be6-5c0a54af26fd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:41.588298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:41.659497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155252c4-bdec-46fc-affd-d1605af75a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:41.660123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155252c4-bdec-46fc-affd-d1605af75a71 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:41.660401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155252c4-bdec-46fc-affd-d1605af75a71 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:41.660665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155252c4-bdec-46fc-affd-d1605af75a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:41.662418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-155252c4-bdec-46fc-affd-d1605af75a71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:41.813954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155252c4-bdec-46fc-affd-d1605af75a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:41.816609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155252c4-bdec-46fc-affd-d1605af75a71 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:41.841869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 724/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:42.960925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da1c7-a73c-4abd-995c-8df7b7af32d5 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:42.961819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da1c7-a73c-4abd-995c-8df7b7af32d5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:42.961819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da1c7-a73c-4abd-995c-8df7b7af32d5 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:42.963357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:42.971779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2981cd-0315-435d-91a1-877fdccba4b2 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:42.972378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2981cd-0315-435d-91a1-877fdccba4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:42.972788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2981cd-0315-435d-91a1-877fdccba4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:43.079251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2b2981cd-0315-435d-91a1-877fdccba4b2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:43.080571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2b2981cd-0315-435d-91a1-877fdccba4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:43.082954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:43.195733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:43.355216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0da1c7-a73c-4abd-995c-8df7b7af32d5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:43.356937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6a0da1c7-a73c-4abd-995c-8df7b7af32d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:43.548278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0da1c7-a73c-4abd-995c-8df7b7af32d5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:43.584327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:43.691538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f299949-45a9-4e0d-abf4-b1dbb711205a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:43.692465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299949-45a9-4e0d-abf4-b1dbb711205a service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:43.692911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299949-45a9-4e0d-abf4-b1dbb711205a service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:43.693336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299949-45a9-4e0d-abf4-b1dbb711205a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:43.697845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6f299949-45a9-4e0d-abf4-b1dbb711205a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:43.823247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f299949-45a9-4e0d-abf4-b1dbb711205a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:43.825302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f299949-45a9-4e0d-abf4-b1dbb711205a service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:43.849911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 715/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:32:46.009030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d108c31-3c75-416f-8b76-fb708351e83e None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:46.009624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d108c31-3c75-416f-8b76-fb708351e83e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:46.009624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d108c31-3c75-416f-8b76-fb708351e83e None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:46.010908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:46.017998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b21fd-d693-4898-af35-b339fd5ea0d5 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:46.018531 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b21fd-d693-4898-af35-b339fd5ea0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:46.018637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b21fd-d693-4898-af35-b339fd5ea0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:46.068970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:46.098350 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-bb2b21fd-d693-4898-af35-b339fd5ea0d5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:46.099591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bb2b21fd-d693-4898-af35-b339fd5ea0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:46.222112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:46.519152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d108c31-3c75-416f-8b76-fb708351e83e None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:46.521359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1d108c31-3c75-416f-8b76-fb708351e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:46.651100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d108c31-3c75-416f-8b76-fb708351e83e None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:46.690458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:46.755891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4cc8a-8a21-462f-a71b-d71e9dec7fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:46.756627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4cc8a-8a21-462f-a71b-d71e9dec7fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:46.756906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4cc8a-8a21-462f-a71b-d71e9dec7fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:46.757212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4cc8a-8a21-462f-a71b-d71e9dec7fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:46.759588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d0d4cc8a-8a21-462f-a71b-d71e9dec7fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:46.911757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4cc8a-8a21-462f-a71b-d71e9dec7fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:46.914694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4cc8a-8a21-462f-a71b-d71e9dec7fb3 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:46.951271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 727/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:32:49.496075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3123725-97f9-4020-8c99-2b6505173220 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:49.496676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3123725-97f9-4020-8c99-2b6505173220 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:49.496676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3123725-97f9-4020-8c99-2b6505173220 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:49.498369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:32:49.505611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4217c53-ba29-4918-b105-597914660ba5 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:49.506257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4217c53-ba29-4918-b105-597914660ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:49.506582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4217c53-ba29-4918-b105-597914660ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:49.593363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e4217c53-ba29-4918-b105-597914660ba5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:49.594636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e4217c53-ba29-4918-b105-597914660ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:49.610275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:49.720119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:50.236602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3123725-97f9-4020-8c99-2b6505173220 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:50.238266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c3123725-97f9-4020-8c99-2b6505173220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:50.376283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3123725-97f9-4020-8c99-2b6505173220 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:50.394482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:50.524325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603cc5d-bdd3-48b4-866a-ddbadcb94c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:50.525768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603cc5d-bdd3-48b4-866a-ddbadcb94c18 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:50.526337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603cc5d-bdd3-48b4-866a-ddbadcb94c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:50.526902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603cc5d-bdd3-48b4-866a-ddbadcb94c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:50.530405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f603cc5d-bdd3-48b4-866a-ddbadcb94c18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:50.757337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603cc5d-bdd3-48b4-866a-ddbadcb94c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:50.760373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603cc5d-bdd3-48b4-866a-ddbadcb94c18 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:50.799021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 718/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:32:53.660890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b8932-48aa-4c67-bb7b-e21306b88a70 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:53.661556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b8932-48aa-4c67-bb7b-e21306b88a70 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:53.661556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b8932-48aa-4c67-bb7b-e21306b88a70 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:53.662852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:53.669825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fc1b-3be6-4d5c-bd67-a3b8177a9228 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:53.670499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fc1b-3be6-4d5c-bd67-a3b8177a9228 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:53.670499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3fc1b-3be6-4d5c-bd67-a3b8177a9228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:53.730585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:53.752665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-deb3fc1b-3be6-4d5c-bd67-a3b8177a9228 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:53.754056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-deb3fc1b-3be6-4d5c-bd67-a3b8177a9228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:53.872324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:32:54.170111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b8932-48aa-4c67-bb7b-e21306b88a70 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:54.171902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7a0b8932-48aa-4c67-bb7b-e21306b88a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:54.298240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b8932-48aa-4c67-bb7b-e21306b88a70 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:54.364259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:54.406654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dd6a3-66a7-4f36-8d0e-22a87da1d76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:54.407392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dd6a3-66a7-4f36-8d0e-22a87da1d76a service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:54.407719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dd6a3-66a7-4f36-8d0e-22a87da1d76a service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:54.408053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dd6a3-66a7-4f36-8d0e-22a87da1d76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:54.409962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6f4dd6a3-66a7-4f36-8d0e-22a87da1d76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:54.539499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dd6a3-66a7-4f36-8d0e-22a87da1d76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:54.541489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dd6a3-66a7-4f36-8d0e-22a87da1d76a service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:54.561678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 730/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:32:57.020368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3b05-1654-4ef4-9e1b-47f613d140b0 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:57.020368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3b05-1654-4ef4-9e1b-47f613d140b0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:57.020368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3b05-1654-4ef4-9e1b-47f613d140b0 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:57.021769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:32:57.030604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5068-8fd9-4729-afd6-84a3e36752be None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:57.031302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5068-8fd9-4729-afd6-84a3e36752be None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:57.031302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd5068-8fd9-4729-afd6-84a3e36752be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:57.121678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e6bd5068-8fd9-4729-afd6-84a3e36752be None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:32:57.123875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e6bd5068-8fd9-4729-afd6-84a3e36752be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:57.160248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:57.260527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:32:57.549699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b3b05-1654-4ef4-9e1b-47f613d140b0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:32:57.551416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ca3b3b05-1654-4ef4-9e1b-47f613d140b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:57.668781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b3b05-1654-4ef4-9e1b-47f613d140b0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:32:57.698574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:32:57.765241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9f106-988d-4608-902f-ce36e7a06007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:32:57.765939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9f106-988d-4608-902f-ce36e7a06007 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:32:57.766225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9f106-988d-4608-902f-ce36e7a06007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:32:57.766501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9f106-988d-4608-902f-ce36e7a06007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:32:57.768178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-77e9f106-988d-4608-902f-ce36e7a06007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:32:57.899066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9f106-988d-4608-902f-ce36e7a06007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:32:57.901133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9f106-988d-4608-902f-ce36e7a06007 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:32:57.921120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 721/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:00.276000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193287d-f530-4970-86cf-b0fed28c2cdd None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:00.276797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193287d-f530-4970-86cf-b0fed28c2cdd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:00.277537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193287d-f530-4970-86cf-b0fed28c2cdd None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:00.280772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:33:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:33:00.287490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a497-5a83-4a85-af9d-9aad1599357b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:00.288091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a497-5a83-4a85-af9d-9aad1599357b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:00.288091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a497-5a83-4a85-af9d-9aad1599357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:00.364784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:00.368459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-adb9a497-5a83-4a85-af9d-9aad1599357b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:00.370308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-adb9a497-5a83-4a85-af9d-9aad1599357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:00.506425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:33:00.812487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193287d-f530-4970-86cf-b0fed28c2cdd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:00.814232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c193287d-f530-4970-86cf-b0fed28c2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:00.947461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193287d-f530-4970-86cf-b0fed28c2cdd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:01.003757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:01.033962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b4460-1ab4-4acb-a396-56174ceb4b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:01.034579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4460-1ab4-4acb-a396-56174ceb4b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:01.034859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4460-1ab4-4acb-a396-56174ceb4b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:01.035164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b4460-1ab4-4acb-a396-56174ceb4b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:01.036862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-275b4460-1ab4-4acb-a396-56174ceb4b8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:01.173698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b4460-1ab4-4acb-a396-56174ceb4b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:01.175153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b4460-1ab4-4acb-a396-56174ceb4b8b service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:01.195451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 733/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:33:03.572993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02883-1ef7-4ff2-818d-e17d6a4df87f None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:03.573877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02883-1ef7-4ff2-818d-e17d6a4df87f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:03.573877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02883-1ef7-4ff2-818d-e17d6a4df87f None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:03.574941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:33:03.581866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea3fa3-2abc-475e-b9df-bb1b042889e2 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:03.582745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea3fa3-2abc-475e-b9df-bb1b042889e2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:03.582745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea3fa3-2abc-475e-b9df-bb1b042889e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:03.660393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-12ea3fa3-2abc-475e-b9df-bb1b042889e2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:03.661673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-12ea3fa3-2abc-475e-b9df-bb1b042889e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:03.704813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:03.788868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:04.106769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02883-1ef7-4ff2-818d-e17d6a4df87f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:04.108368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-99c02883-1ef7-4ff2-818d-e17d6a4df87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:04.234388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02883-1ef7-4ff2-818d-e17d6a4df87f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:04.269486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:04.324915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879adc3-744f-45db-9368-7a6f7e20e516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:04.325576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879adc3-744f-45db-9368-7a6f7e20e516 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:04.325865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879adc3-744f-45db-9368-7a6f7e20e516 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:04.326144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879adc3-744f-45db-9368-7a6f7e20e516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:04.328224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c879adc3-744f-45db-9368-7a6f7e20e516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:04.456070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879adc3-744f-45db-9368-7a6f7e20e516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:04.457534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879adc3-744f-45db-9368-7a6f7e20e516 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:04.597813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 724/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:33:06.941076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d438-ed19-428a-aa0f-15c149d6fac3 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:06.941729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d438-ed19-428a-aa0f-15c149d6fac3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:06.942081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95d438-ed19-428a-aa0f-15c149d6fac3 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:06.944385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:33:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:33:06.951807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2de7-63f1-414c-9359-8a8452e58d8a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:06.952701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2de7-63f1-414c-9359-8a8452e58d8a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:06.952701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2de7-63f1-414c-9359-8a8452e58d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:07.036674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-873b2de7-63f1-414c-9359-8a8452e58d8a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:07.038031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-873b2de7-63f1-414c-9359-8a8452e58d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:07.047728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:07.154727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:33:07.448692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95d438-ed19-428a-aa0f-15c149d6fac3 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:07.450393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1a95d438-ed19-428a-aa0f-15c149d6fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:07.579056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95d438-ed19-428a-aa0f-15c149d6fac3 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:07.648090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:07.670202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98369372-ada1-4761-b14e-8c368da00a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:07.670832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369372-ada1-4761-b14e-8c368da00a13 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:07.671110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369372-ada1-4761-b14e-8c368da00a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:07.671388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369372-ada1-4761-b14e-8c368da00a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:07.673092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-98369372-ada1-4761-b14e-8c368da00a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:07.810874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98369372-ada1-4761-b14e-8c368da00a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:07.812342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98369372-ada1-4761-b14e-8c368da00a13 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:07.832967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 736/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:33:10.161755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e40bb8-9e4d-426f-ae1c-d72375a8280b None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:10.162582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e40bb8-9e4d-426f-ae1c-d72375a8280b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:10.162772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e40bb8-9e4d-426f-ae1c-d72375a8280b None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:10.164317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:33:10.171223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6946ff7-6704-426e-b189-cdf2c638613c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:10.171812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6946ff7-6704-426e-b189-cdf2c638613c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:10.171812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6946ff7-6704-426e-b189-cdf2c638613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:10.257081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a6946ff7-6704-426e-b189-cdf2c638613c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:10.258350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a6946ff7-6704-426e-b189-cdf2c638613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:10.304322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:10.372564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:10.674930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e40bb8-9e4d-426f-ae1c-d72375a8280b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:10.676489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f3e40bb8-9e4d-426f-ae1c-d72375a8280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:10.801585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e40bb8-9e4d-426f-ae1c-d72375a8280b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:10.846565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:10.890488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f8da5-d0b7-4329-8146-9e4dc2d2ba2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:10.891113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f8da5-d0b7-4329-8146-9e4dc2d2ba2b service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:10.891396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f8da5-d0b7-4329-8146-9e4dc2d2ba2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:10.891670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f8da5-d0b7-4329-8146-9e4dc2d2ba2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:10.893367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a79f8da5-d0b7-4329-8146-9e4dc2d2ba2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:11.037829 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f8da5-d0b7-4329-8146-9e4dc2d2ba2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:11.039401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f8da5-d0b7-4329-8146-9e4dc2d2ba2b service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:11.060421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 727/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:13.394196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e65ef-71e1-45ab-a1f0-823b23a3507b None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:13.395167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e65ef-71e1-45ab-a1f0-823b23a3507b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:13.395167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e65ef-71e1-45ab-a1f0-823b23a3507b None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:13.396333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:33:13.404040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ea3c-d37a-42f4-abf6-a716c3b40260 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:13.404644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ea3c-d37a-42f4-abf6-a716c3b40260 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:13.405007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ea3c-d37a-42f4-abf6-a716c3b40260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:13.493565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f115ea3c-d37a-42f4-abf6-a716c3b40260 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:13.494871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f115ea3c-d37a-42f4-abf6-a716c3b40260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:13.518701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:13.613336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:14.023848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e65ef-71e1-45ab-a1f0-823b23a3507b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:14.025549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-002e65ef-71e1-45ab-a1f0-823b23a3507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:14.179215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e65ef-71e1-45ab-a1f0-823b23a3507b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:14.265879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:14.275948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ece4f-4e77-4edf-83ea-b48db71b1dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:14.277041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ece4f-4e77-4edf-83ea-b48db71b1dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:14.277319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ece4f-4e77-4edf-83ea-b48db71b1dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:14.277706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ece4f-4e77-4edf-83ea-b48db71b1dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:14.279586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7e1ece4f-4e77-4edf-83ea-b48db71b1dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:14.423003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ece4f-4e77-4edf-83ea-b48db71b1dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:14.425140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ece4f-4e77-4edf-83ea-b48db71b1dc1 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:14.447705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 739/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:16.768940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcac06-d199-409a-acd1-9b9274a79c2a None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:16.769573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcac06-d199-409a-acd1-9b9274a79c2a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:16.769749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcac06-d199-409a-acd1-9b9274a79c2a None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:16.771181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:33:16.778570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0654fd-f8c5-4dc1-beb1-d0a823096b5e None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:16.779161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0654fd-f8c5-4dc1-beb1-d0a823096b5e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:16.779563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0654fd-f8c5-4dc1-beb1-d0a823096b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:16.863373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3c0654fd-f8c5-4dc1-beb1-d0a823096b5e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:16.864654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3c0654fd-f8c5-4dc1-beb1-d0a823096b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:16.923209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:16.981498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:17.270665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcac06-d199-409a-acd1-9b9274a79c2a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:17.272203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1dbcac06-d199-409a-acd1-9b9274a79c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:17.398130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcac06-d199-409a-acd1-9b9274a79c2a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:17.451941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:17.483101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a7dc7-b98d-4025-98ef-24b4c6de4974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:17.483706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7dc7-b98d-4025-98ef-24b4c6de4974 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:17.483990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7dc7-b98d-4025-98ef-24b4c6de4974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:17.484262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a7dc7-b98d-4025-98ef-24b4c6de4974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:17.485979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5e1a7dc7-b98d-4025-98ef-24b4c6de4974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:17.610790 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7dc7-b98d-4025-98ef-24b4c6de4974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:17.612152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a7dc7-b98d-4025-98ef-24b4c6de4974 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:17.632920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 730/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:26.979473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=22 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:27.630052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=66 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:39.061241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0711-feb2-4ff2-95c9-b29790031dcb None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:39.061953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0711-feb2-4ff2-95c9-b29790031dcb None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:39.061953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0711-feb2-4ff2-95c9-b29790031dcb None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:39.063301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 741/1471] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:33:39.069686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48bf7-3374-46dd-b638-1258fe07e294 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:39.070364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48bf7-3374-46dd-b638-1258fe07e294 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:39.070522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef48bf7-3374-46dd-b638-1258fe07e294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:39.152642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cef48bf7-3374-46dd-b638-1258fe07e294 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:39.153997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cef48bf7-3374-46dd-b638-1258fe07e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:39.304917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 731/1472] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:39.609292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1549-d7fd-4198-8456-641040d37aeb None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:39.609612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1549-d7fd-4198-8456-641040d37aeb None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:39.609894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1549-d7fd-4198-8456-641040d37aeb None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:39.611318 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 742/1473] 10.222.0.17 () {54 vars in 962 bytes} [Mon Oct 3 12:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:33:39.617124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6b94-2a47-467e-a1c9-40910a93d753 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:39.617411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6b94-2a47-467e-a1c9-40910a93d753 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:39.617736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a6b94-2a47-467e-a1c9-40910a93d753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:39.717610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-191a6b94-2a47-467e-a1c9-40910a93d753 None None] MFA Rules not processed for user `d676c76b05924c4ab06940f04996fa3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:39.718869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-191a6b94-2a47-467e-a1c9-40910a93d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:39.742244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:39.818156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 732/1474] 10.222.0.17 () {58 vars in 1059 bytes} [Mon Oct 3 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:39.831536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1549-d7fd-4198-8456-641040d37aeb None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:39.833161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-409e1549-d7fd-4198-8456-641040d37aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:39.964246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1549-d7fd-4198-8456-641040d37aeb None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:40.051851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90d51b-5232-4118-b13b-0c092bd4cd6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:40.052523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d51b-5232-4118-b13b-0c092bd4cd6e service glance] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:40.052849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d51b-5232-4118-b13b-0c092bd4cd6e service glance] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:40.053169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90d51b-5232-4118-b13b-0c092bd4cd6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:40.054965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6f90d51b-5232-4118-b13b-0c092bd4cd6e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:40.119415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:40.185252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90d51b-5232-4118-b13b-0c092bd4cd6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:40.186777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90d51b-5232-4118-b13b-0c092bd4cd6e service glance] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:40.207502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 743/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:42.606997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7228a5-687c-48b7-bcdf-75e0f0984587 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:42.607575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7228a5-687c-48b7-bcdf-75e0f0984587 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:42.607575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7228a5-687c-48b7-bcdf-75e0f0984587 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:42.608921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 733/1476] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:33:42.615170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a51e-6c7d-4b1f-96da-081bf1a01dfd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:42.615744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a51e-6c7d-4b1f-96da-081bf1a01dfd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:42.615744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a51e-6c7d-4b1f-96da-081bf1a01dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:42.699773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3b96a51e-6c7d-4b1f-96da-081bf1a01dfd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:42.701832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3b96a51e-6c7d-4b1f-96da-081bf1a01dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:42.813296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 744/1477] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:33:43.092379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7228a5-687c-48b7-bcdf-75e0f0984587 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:43.093995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2f7228a5-687c-48b7-bcdf-75e0f0984587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:43.293154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7228a5-687c-48b7-bcdf-75e0f0984587 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:43.355578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:43.413942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ed4fa-e72a-44d0-8287-baa8a46a6006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:43.414558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ed4fa-e72a-44d0-8287-baa8a46a6006 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:43.414835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ed4fa-e72a-44d0-8287-baa8a46a6006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:43.415103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ed4fa-e72a-44d0-8287-baa8a46a6006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:43.415837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ed4fa-e72a-44d0-8287-baa8a46a6006 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:43.418262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-c11ed4fa-e72a-44d0-8287-baa8a46a6006 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:33:43.418262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: warnings.warn(msg) Oct 03 12:33:43.418262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: Oct 03 12:33:43.419981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ed4fa-e72a-44d0-8287-baa8a46a6006 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:43.448866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 734/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Mon Oct 3 12:33:43 2022] GET /identity/v3/projects => generated 2553 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:33:45.781129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ffaf2-fdb6-4331-ba6f-69aaa0cfe10b None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:45.781800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ffaf2-fdb6-4331-ba6f-69aaa0cfe10b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:45.781800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ffaf2-fdb6-4331-ba6f-69aaa0cfe10b None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:45.783150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 745/1479] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:33:45.789646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9132-20e7-4f6d-a94f-b752667679d9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:45.790502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9132-20e7-4f6d-a94f-b752667679d9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:45.790725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9132-20e7-4f6d-a94f-b752667679d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:45.874826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2a8a9132-20e7-4f6d-a94f-b752667679d9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:45.876235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a8a9132-20e7-4f6d-a94f-b752667679d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:45.997317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 735/1480] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:33:46.317557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ffaf2-fdb6-4331-ba6f-69aaa0cfe10b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:46.319252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-522ffaf2-fdb6-4331-ba6f-69aaa0cfe10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:46.333155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:46.550451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ffaf2-fdb6-4331-ba6f-69aaa0cfe10b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:46.650312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:46.691368 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7dc2-6957-4020-a4c5-231cbc278107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:46.692303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7dc2-6957-4020-a4c5-231cbc278107 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:46.692688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7dc2-6957-4020-a4c5-231cbc278107 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:46.693064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7dc2-6957-4020-a4c5-231cbc278107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:46.695397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-494c7dc2-6957-4020-a4c5-231cbc278107 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:46.833279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7dc2-6957-4020-a4c5-231cbc278107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:46.836582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7dc2-6957-4020-a4c5-231cbc278107 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:46.872810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 746/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:49.377855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78331a5-c8d8-4546-9f86-561ab4695001 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:49.378779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78331a5-c8d8-4546-9f86-561ab4695001 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:49.378779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78331a5-c8d8-4546-9f86-561ab4695001 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:49.379881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 736/1482] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:33:49.386443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13ab7-6750-436b-bc47-0cac89e49d9a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:49.386994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13ab7-6750-436b-bc47-0cac89e49d9a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:49.386994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13ab7-6750-436b-bc47-0cac89e49d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:49.468054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-30a13ab7-6750-436b-bc47-0cac89e49d9a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:49.469495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-30a13ab7-6750-436b-bc47-0cac89e49d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:49.530453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:49.598155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 747/1483] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:49.903478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78331a5-c8d8-4546-9f86-561ab4695001 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:49.905796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b78331a5-c8d8-4546-9f86-561ab4695001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:49.934723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:50.050671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78331a5-c8d8-4546-9f86-561ab4695001 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:50.139270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d181db0-4c45-4319-8084-cc90a2412f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:50.139905 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d181db0-4c45-4319-8084-cc90a2412f15 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:50.140177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d181db0-4c45-4319-8084-cc90a2412f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:50.140457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d181db0-4c45-4319-8084-cc90a2412f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:50.142184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1d181db0-4c45-4319-8084-cc90a2412f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:50.230658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:50.275077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d181db0-4c45-4319-8084-cc90a2412f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:50.276534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d181db0-4c45-4319-8084-cc90a2412f15 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:50.296738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 737/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:52.723725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0a63-018a-4484-ab22-f82cbff09551 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:52.724503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0a63-018a-4484-ab22-f82cbff09551 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:52.724503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a0a63-018a-4484-ab22-f82cbff09551 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:52.726003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 748/1485] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:33:52.733352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e08c9-ce11-4172-a4d1-22d9785f418d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:52.734045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e08c9-ce11-4172-a4d1-22d9785f418d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:52.734045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e08c9-ce11-4172-a4d1-22d9785f418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:52.850566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-016e08c9-ce11-4172-a4d1-22d9785f418d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:52.852620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-016e08c9-ce11-4172-a4d1-22d9785f418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:52.987240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 738/1486] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:53.284005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0a63-018a-4484-ab22-f82cbff09551 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:53.285779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-986a0a63-018a-4484-ab22-f82cbff09551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:53.408928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a0a63-018a-4484-ab22-f82cbff09551 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:53.498635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:53.500504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6b234-b931-48a6-a460-359cf8477173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:53.501338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b234-b931-48a6-a460-359cf8477173 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:53.502170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b234-b931-48a6-a460-359cf8477173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:53.502549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6b234-b931-48a6-a460-359cf8477173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:53.505834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c4a6b234-b931-48a6-a460-359cf8477173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:53.641136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6b234-b931-48a6-a460-359cf8477173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:53.642733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6b234-b931-48a6-a460-359cf8477173 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:53.664795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 749/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:56.250498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee279-6c1a-441e-8a0e-6e39b1adefde None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:56.251252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee279-6c1a-441e-8a0e-6e39b1adefde None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:56.251252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee279-6c1a-441e-8a0e-6e39b1adefde None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:56.252537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 739/1488] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:33:56.258848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccca09-9acc-4afb-af30-d063a582cb7b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:56.259405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccca09-9acc-4afb-af30-d063a582cb7b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:56.259405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccca09-9acc-4afb-af30-d063a582cb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:56.338803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-30ccca09-9acc-4afb-af30-d063a582cb7b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:56.340134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-30ccca09-9acc-4afb-af30-d063a582cb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:56.411563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:56.475113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 750/1489] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:33:56.774929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee279-6c1a-441e-8a0e-6e39b1adefde None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:33:56.776521 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-45eee279-6c1a-441e-8a0e-6e39b1adefde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:56.820931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:56.902637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee279-6c1a-441e-8a0e-6e39b1adefde None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:33:57.028202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca1e2f-9235-47cc-8800-e5d511616582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:33:57.029147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1e2f-9235-47cc-8800-e5d511616582 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:57.030180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1e2f-9235-47cc-8800-e5d511616582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:57.030667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca1e2f-9235-47cc-8800-e5d511616582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:57.033942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-89ca1e2f-9235-47cc-8800-e5d511616582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:33:57.168045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:33:57.202693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca1e2f-9235-47cc-8800-e5d511616582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:33:57.204227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca1e2f-9235-47cc-8800-e5d511616582 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:33:57.227294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 740/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:33:59.786314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9402d-5bab-4bc4-ae70-f1a152b3dc7c None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:59.786978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9402d-5bab-4bc4-ae70-f1a152b3dc7c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:59.786978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9402d-5bab-4bc4-ae70-f1a152b3dc7c None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:59.788227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 751/1491] 10.222.0.17 () {54 vars in 927 bytes} [Mon Oct 3 12:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:33:59.794456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00cc51-c4bf-4f38-aadd-183adcb6eeed None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:33:59.795296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00cc51-c4bf-4f38-aadd-183adcb6eeed None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:33:59.795296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00cc51-c4bf-4f38-aadd-183adcb6eeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:33:59.875926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3c00cc51-c4bf-4f38-aadd-183adcb6eeed None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:33:59.877190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3c00cc51-c4bf-4f38-aadd-183adcb6eeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:34:00.005868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 741/1492] 10.222.0.17 () {58 vars in 1024 bytes} [Mon Oct 3 12:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:34:00.302243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9402d-5bab-4bc4-ae70-f1a152b3dc7c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:34:00.304061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-45c9402d-5bab-4bc4-ae70-f1a152b3dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:34:00.426726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9402d-5bab-4bc4-ae70-f1a152b3dc7c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:34:00.513291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390adc6-4086-4fdc-8c50-d35964af1ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:34:00.514002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390adc6-4086-4fdc-8c50-d35964af1ced service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:34:00.514287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390adc6-4086-4fdc-8c50-d35964af1ced service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:34:00.514569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390adc6-4086-4fdc-8c50-d35964af1ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:34:00.516467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d390adc6-4086-4fdc-8c50-d35964af1ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:34:00.526528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:34:00.657323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390adc6-4086-4fdc-8c50-d35964af1ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:34:00.658809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390adc6-4086-4fdc-8c50-d35964af1ced service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:34:00.680804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 752/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:34:10.003836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=82 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:34:10.678309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=50 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:35:20.308438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0bf33-1bf9-4d5d-8e3a-f9eb70237cd3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:20.309131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0bf33-1bf9-4d5d-8e3a-f9eb70237cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:20.309131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0bf33-1bf9-4d5d-8e3a-f9eb70237cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:20.408417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-37e0bf33-1bf9-4d5d-8e3a-f9eb70237cd3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:35:20.409486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-37e0bf33-1bf9-4d5d-8e3a-f9eb70237cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:35:20.542325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 742/1494] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:35:20.551631 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0a8bd-84d3-4599-a5e5-1ce3af82d225 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:20.552366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0a8bd-84d3-4599-a5e5-1ce3af82d225 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:20.552366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0a8bd-84d3-4599-a5e5-1ce3af82d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:20.576676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-feb0a8bd-84d3-4599-a5e5-1ce3af82d225 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:35:20.577888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-feb0a8bd-84d3-4599-a5e5-1ce3af82d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:35:20.587149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 753/1495] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:35:20.592848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0bf33-1bf9-4d5d-8e3a-f9eb70237cd3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:20.609245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0bf33-1bf9-4d5d-8e3a-f9eb70237cd3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:20.617605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:20.618644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:20.619120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:20.619603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:20.620792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:35:20.621327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:20.623219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:35:20.623219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: warnings.warn(msg) Oct 03 12:35:20.623219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: Oct 03 12:35:20.625006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:20.647398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 743/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:35:20.656876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0a8bd-84d3-4599-a5e5-1ce3af82d225 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:20.666829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0a8bd-84d3-4599-a5e5-1ce3af82d225 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:20.671665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:20.672877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:20.673156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:20.673431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:20.674218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:20.676860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING py.warnings [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:35:20.676860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: warnings.warn(msg) Oct 03 12:35:20.676860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: Oct 03 12:35:20.678948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:20.728139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 754/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:35:20 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:35:20.732647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:20.744464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3db0e-9494-44f9-88e2-ddff156865bd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:20.804811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:35:20.812849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:20.813495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:20.813822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:20.814101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:20.814805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:20.815869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:35:20.815869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: warnings.warn(msg) Oct 03 12:35:20.815869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: Oct 03 12:35:20.817103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:20.842208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 744/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:35:20 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:35:20.847902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:20.860158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973c7f6-1550-4ec6-a16c-84d28ca08a23 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:20.865410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:20.866157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:20.866489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:20.866837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:20.867587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:20.868692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING py.warnings [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:35:20.868692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: warnings.warn(msg) Oct 03 12:35:20.868692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: Oct 03 12:35:20.870240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:20.885474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 755/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:35:20.892308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:20.911006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c8e59-0374-4613-8820-a8c5779b853a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:20.919044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90285c2-cf9c-4cf1-8cae-b4a88897beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:20.920109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90285c2-cf9c-4cf1-8cae-b4a88897beac admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:20.920616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90285c2-cf9c-4cf1-8cae-b4a88897beac admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:20.921112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90285c2-cf9c-4cf1-8cae-b4a88897beac admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:20.923028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90285c2-cf9c-4cf1-8cae-b4a88897beac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:20.924941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-a90285c2-cf9c-4cf1-8cae-b4a88897beac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:35:20.924941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: warnings.warn(msg) Oct 03 12:35:20.924941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: Oct 03 12:35:20.926758 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90285c2-cf9c-4cf1-8cae-b4a88897beac admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:20.951334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 745/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:35:20.956671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:20.968609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63be1b-329b-40ae-8422-875b08310290 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:20.979286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31209f76-ec59-4d6e-895f-e2fbabc6779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:20.980150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209f76-ec59-4d6e-895f-e2fbabc6779d admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:20.980574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209f76-ec59-4d6e-895f-e2fbabc6779d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:20.980931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209f76-ec59-4d6e-895f-e2fbabc6779d admin admin] PATH_INFO: `/v3/projects/40c5820443c341ce89de313f391dcdad/users/aa7ad04b59844472ba7b73664e9b5c78/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:20.999340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31209f76-ec59-4d6e-895f-e2fbabc6779d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c5820443c341ce89de313f391dcdad, user_id=aa7ad04b59844472ba7b73664e9b5c78, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:21.000467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING py.warnings [None req-31209f76-ec59-4d6e-895f-e2fbabc6779d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:35:21.000467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: warnings.warn(msg) Oct 03 12:35:21.000467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: Oct 03 12:35:21.003640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31209f76-ec59-4d6e-895f-e2fbabc6779d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:21.020765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 756/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:35:20 2022] PUT /identity/v3/projects/40c5820443c341ce89de313f391dcdad/users/aa7ad04b59844472ba7b73664e9b5c78/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:35:21.034957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee58d-abde-43d6-ac76-194aa924615f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:21.035234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee58d-abde-43d6-ac76-194aa924615f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:21.035504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee58d-abde-43d6-ac76-194aa924615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:21.077294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-68cee58d-abde-43d6-ac76-194aa924615f None None] MFA Rules not processed for user `aa7ad04b59844472ba7b73664e9b5c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:35:21.079475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-68cee58d-abde-43d6-ac76-194aa924615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:35:21.199122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 746/1502] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:35:21.213784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac88a0-3459-4e21-ae80-7d1cdec6b8a6 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:21.214117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac88a0-3459-4e21-ae80-7d1cdec6b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:21.214334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac88a0-3459-4e21-ae80-7d1cdec6b8a6 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:21.215749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 757/1503] 10.222.0.17 () {54 vars in 963 bytes} [Mon Oct 3 12:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:35:21.223144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5d80-e50e-40db-8ef8-4577ba6859d0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:21.223578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5d80-e50e-40db-8ef8-4577ba6859d0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:21.223978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5d80-e50e-40db-8ef8-4577ba6859d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:21.330816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2f5b5d80-e50e-40db-8ef8-4577ba6859d0 None None] MFA Rules not processed for user `1e81eb41d8264474917e3b4f3fa2becd`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:35:21.332794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2f5b5d80-e50e-40db-8ef8-4577ba6859d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:35:21.435523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 747/1504] 10.222.0.17 () {58 vars in 1060 bytes} [Mon Oct 3 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:35:21.446219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac88a0-3459-4e21-ae80-7d1cdec6b8a6 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:21.459060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac88a0-3459-4e21-ae80-7d1cdec6b8a6 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:21.462807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2875b6c-2cc4-4110-8fe2-47d385fa7401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:21.463432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875b6c-2cc4-4110-8fe2-47d385fa7401 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:21.463710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875b6c-2cc4-4110-8fe2-47d385fa7401 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:21.463986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875b6c-2cc4-4110-8fe2-47d385fa7401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:21.474315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2875b6c-2cc4-4110-8fe2-47d385fa7401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:21.475771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2875b6c-2cc4-4110-8fe2-47d385fa7401 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:21.486059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 758/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:35:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:35:21.545501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183bc9-d735-45d4-8ec7-0a5cae9380f2 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:21.545885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183bc9-d735-45d4-8ec7-0a5cae9380f2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:21.546206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183bc9-d735-45d4-8ec7-0a5cae9380f2 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:21.547550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 748/1506] 10.222.0.17 () {52 vars in 830 bytes} [Mon Oct 3 12:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:35:21.552347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2875b6c-2cc4-4110-8fe2-47d385fa7401 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:21.629280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2875b6c-2cc4-4110-8fe2-47d385fa7401 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:21.634960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:21.635732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:21.636095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:21.636420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] PATH_INFO: `/v3/users/aa7ad04b59844472ba7b73664e9b5c78` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:21.637886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7ad04b59844472ba7b73664e9b5c78)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:21.639025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING py.warnings [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:35:21.639025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: warnings.warn(msg) Oct 03 12:35:21.639025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: Oct 03 12:35:21.640440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:21.735550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7ad04b59844472ba7b73664e9b5c78'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:21.754844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7ad04b59844472ba7b73664e9b5c78'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:21.755634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7ad04b59844472ba7b73664e9b5c78'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:21.756375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7ad04b59844472ba7b73664e9b5c78'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:21.769638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7ad04b59844472ba7b73664e9b5c78'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:21.798015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:35:21.809280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 759/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:35:21 2022] DELETE /identity/v3/users/aa7ad04b59844472ba7b73664e9b5c78 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:35:21.814924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4683cf8-fb24-4e1a-9e7c-c9683906c78e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:21.815346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4683cf8-fb24-4e1a-9e7c-c9683906c78e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:21.815799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4683cf8-fb24-4e1a-9e7c-c9683906c78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:21.837928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f4683cf8-fb24-4e1a-9e7c-c9683906c78e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:35:21.839185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f4683cf8-fb24-4e1a-9e7c-c9683906c78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:35:21.854808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:35:21.915713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 749/1508] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:35:21.927048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:21.928588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:35:22.022046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455ff40-a711-4b3e-85a3-4845e257fd6d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:22.026003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6f5aa-0cf0-44cf-8a56-7e8e992c977a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:22.026778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f5aa-0cf0-44cf-8a56-7e8e992c977a service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:22.027225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f5aa-0cf0-44cf-8a56-7e8e992c977a service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:22.027530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6f5aa-0cf0-44cf-8a56-7e8e992c977a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:22.038274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6f5aa-0cf0-44cf-8a56-7e8e992c977a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:22.039770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6f5aa-0cf0-44cf-8a56-7e8e992c977a service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:22.055930 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 760/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:35:22.471852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4683cf8-fb24-4e1a-9e7c-c9683906c78e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:35:22.473800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f4683cf8-fb24-4e1a-9e7c-c9683906c78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:35:22.489351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4683cf8-fb24-4e1a-9e7c-c9683906c78e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:35:22.496128 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:35:22.496952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:35:22.497396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:35:22.498011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] PATH_INFO: `/v3/projects/40c5820443c341ce89de313f391dcdad` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:35:22.499738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c5820443c341ce89de313f391dcdad)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:35:22.501165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:35:22.501165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: warnings.warn(msg) Oct 03 12:35:22.501165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: Oct 03 12:35:22.503133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:35:22.592712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c5820443c341ce89de313f391dcdad', 'request_id': 'req-e4b27061-23c3-4365-b57a-b675bdc48b03'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:22.604358 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c5820443c341ce89de313f391dcdad', 'request_id': 'req-e4b27061-23c3-4365-b57a-b675bdc48b03'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:22.631716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c5820443c341ce89de313f391dcdad', 'request_id': 'req-e4b27061-23c3-4365-b57a-b675bdc48b03'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:22.653277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] The token cache is being invalidate because project 40c5820443c341ce89de313f391dcdad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:35:22.653850 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:22.654907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e4b27061-23c3-4365-b57a-b675bdc48b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:35:22.657467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 750/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:35:22 2022] DELETE /identity/v3/projects/40c5820443c341ce89de313f391dcdad => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:35:32.047215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:35:32.647146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:36:56.121492 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174da7f-c21a-42ac-b12c-0f914b09a03c None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:36:56.122097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174da7f-c21a-42ac-b12c-0f914b09a03c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:36:56.122097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174da7f-c21a-42ac-b12c-0f914b09a03c None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:36:56.124111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:36:56.133642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612847b6-a3a7-454a-9847-c881562d469b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:36:56.134735 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612847b6-a3a7-454a-9847-c881562d469b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:36:56.134897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612847b6-a3a7-454a-9847-c881562d469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:36:56.168356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-612847b6-a3a7-454a-9847-c881562d469b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:36:56.169736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-612847b6-a3a7-454a-9847-c881562d469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:36:56.256064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:36:56.543871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174da7f-c21a-42ac-b12c-0f914b09a03c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:36:56.546456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4174da7f-c21a-42ac-b12c-0f914b09a03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:36:56.673624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174da7f-c21a-42ac-b12c-0f914b09a03c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:36:56.679897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d31be-9bc2-4e4e-98d4-63e99b993c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:36:56.680625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d31be-9bc2-4e4e-98d4-63e99b993c74 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:36:56.680952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d31be-9bc2-4e4e-98d4-63e99b993c74 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:36:56.681271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d31be-9bc2-4e4e-98d4-63e99b993c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:36:56.695811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d31be-9bc2-4e4e-98d4-63e99b993c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:36:56.698946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d31be-9bc2-4e4e-98d4-63e99b993c74 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:36:56.718415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 762/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:36:57.890077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b285a0-79e3-46bc-8955-33a97266a4ee None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:36:57.890653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b285a0-79e3-46bc-8955-33a97266a4ee None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:36:57.890653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b285a0-79e3-46bc-8955-33a97266a4ee None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:36:57.892036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:36:57.899425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b71b6-78c9-48a8-9243-36e9081f8361 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:36:57.900020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b71b6-78c9-48a8-9243-36e9081f8361 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:36:57.900020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b71b6-78c9-48a8-9243-36e9081f8361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:36:57.903322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa980f1-6430-43da-9216-0314047a3950 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:36:57.903608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa980f1-6430-43da-9216-0314047a3950 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:36:57.903906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa980f1-6430-43da-9216-0314047a3950 None None] PATH_INFO: `/v3` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:36:57.905908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 753/1515] 10.222.0.49 () {54 vars in 925 bytes} [Mon Oct 3 12:36:57 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:36:57.913394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199eee-7e27-4fc5-baa9-45c5387737ca None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:36:57.913901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199eee-7e27-4fc5-baa9-45c5387737ca None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:36:57.914395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a199eee-7e27-4fc5-baa9-45c5387737ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:36:57.931714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f97b71b6-78c9-48a8-9243-36e9081f8361 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:36:57.933694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f97b71b6-78c9-48a8-9243-36e9081f8361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:36:57.943453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 763/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:36:57.983333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2a199eee-7e27-4fc5-baa9-45c5387737ca None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:36:57.984836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a199eee-7e27-4fc5-baa9-45c5387737ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:36:58.070060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 754/1517] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Oct 3 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:36:58.101139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b71b6-78c9-48a8-9243-36e9081f8361 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:36:58.114235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b71b6-78c9-48a8-9243-36e9081f8361 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:36:58.120052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1348a-0cf3-4b85-ab9c-42d8ca96781b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:36:58.120689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1348a-0cf3-4b85-ab9c-42d8ca96781b service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:36:58.120966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1348a-0cf3-4b85-ab9c-42d8ca96781b service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:36:58.121237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1348a-0cf3-4b85-ab9c-42d8ca96781b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:36:58.130311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1348a-0cf3-4b85-ab9c-42d8ca96781b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:36:58.131913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1348a-0cf3-4b85-ab9c-42d8ca96781b service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:36:58.143260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 764/1518] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:37:07.374275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaaf64-edfc-4566-b299-1601b5dada82 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:07.375031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaaf64-edfc-4566-b299-1601b5dada82 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:07.375031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaaf64-edfc-4566-b299-1601b5dada82 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:07.376505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 755/1519] 10.222.0.17 () {54 vars in 961 bytes} [Mon Oct 3 12:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:37:07.382745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5204-e78d-41ec-aa4e-c731dcf0c83c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:07.383613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5204-e78d-41ec-aa4e-c731dcf0c83c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:07.383791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d5204-e78d-41ec-aa4e-c731dcf0c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:07.411884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-0d7d5204-e78d-41ec-aa4e-c731dcf0c83c None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:37:07.413190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0d7d5204-e78d-41ec-aa4e-c731dcf0c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:07.422962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 765/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Oct 3 12:37:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:37:07.431736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaaf64-edfc-4566-b299-1601b5dada82 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:37:07.446804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaaf64-edfc-4566-b299-1601b5dada82 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:37:07.453224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedd826-d0ea-42b0-8ec6-61527ae39529 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:37:07.454204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedd826-d0ea-42b0-8ec6-61527ae39529 service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:07.454586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedd826-d0ea-42b0-8ec6-61527ae39529 service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:07.454965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedd826-d0ea-42b0-8ec6-61527ae39529 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:07.464976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedd826-d0ea-42b0-8ec6-61527ae39529 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:37:07.466678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dedd826-d0ea-42b0-8ec6-61527ae39529 service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:37:07.478196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 756/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:37:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:37:09.715460 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc167b-2ad8-4919-a893-a33ce8eebed9 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:09.716021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc167b-2ad8-4919-a893-a33ce8eebed9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:09.716021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc167b-2ad8-4919-a893-a33ce8eebed9 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:09.718112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:37:09.725071 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f479cd-cda6-4dfe-a1a7-f336cd3584f5 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:09.725875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f479cd-cda6-4dfe-a1a7-f336cd3584f5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:09.725875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f479cd-cda6-4dfe-a1a7-f336cd3584f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:09.748744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-80f479cd-cda6-4dfe-a1a7-f336cd3584f5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:37:09.750265 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-80f479cd-cda6-4dfe-a1a7-f336cd3584f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:09.759044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:37:09.926205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc167b-2ad8-4919-a893-a33ce8eebed9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:37:09.942128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc167b-2ad8-4919-a893-a33ce8eebed9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:37:09.948527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f5f37-ff1e-4d72-9502-4e519ee77241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:37:09.949077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f5f37-ff1e-4d72-9502-4e519ee77241 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:09.949358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f5f37-ff1e-4d72-9502-4e519ee77241 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:09.949676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f5f37-ff1e-4d72-9502-4e519ee77241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:09.959886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f5f37-ff1e-4d72-9502-4e519ee77241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:37:09.961495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f5f37-ff1e-4d72-9502-4e519ee77241 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:37:09.972435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 767/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:37:11.131347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd5480-d5fe-4c73-8bc0-5f83228a0c43 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:11.131900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd5480-d5fe-4c73-8bc0-5f83228a0c43 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:11.131900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd5480-d5fe-4c73-8bc0-5f83228a0c43 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:11.133268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 3 12:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:37:11.140405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2f6dc-b23c-4df1-95b9-30f616bd8124 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:11.140946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2f6dc-b23c-4df1-95b9-30f616bd8124 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:11.141063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2f6dc-b23c-4df1-95b9-30f616bd8124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:11.161604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b0e2f6dc-b23c-4df1-95b9-30f616bd8124 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:37:11.163412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b0e2f6dc-b23c-4df1-95b9-30f616bd8124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:11.172131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 3 12:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:37:11.326216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd5480-d5fe-4c73-8bc0-5f83228a0c43 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:37:11.341378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd5480-d5fe-4c73-8bc0-5f83228a0c43 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:37:11.347863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca39ddc-da50-44fd-b217-d6907efc92e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:37:11.348489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca39ddc-da50-44fd-b217-d6907efc92e4 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:11.348772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca39ddc-da50-44fd-b217-d6907efc92e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:11.349045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca39ddc-da50-44fd-b217-d6907efc92e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:11.359428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca39ddc-da50-44fd-b217-d6907efc92e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:37:11.361135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca39ddc-da50-44fd-b217-d6907efc92e4 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:37:11.372369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 759/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:37:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:37:15.700422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf67a99-f7d8-4d7c-9cae-101b77c3b975 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:15.700988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf67a99-f7d8-4d7c-9cae-101b77c3b975 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:15.701154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf67a99-f7d8-4d7c-9cae-101b77c3b975 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:15.703234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:37:15.709143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d50ca6-1ab5-4ee7-908e-b1cc1c338377 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:15.709907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d50ca6-1ab5-4ee7-908e-b1cc1c338377 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:15.709907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d50ca6-1ab5-4ee7-908e-b1cc1c338377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:15.730663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d8d50ca6-1ab5-4ee7-908e-b1cc1c338377 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:37:15.731899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d8d50ca6-1ab5-4ee7-908e-b1cc1c338377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:15.740515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:37:16.029787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf67a99-f7d8-4d7c-9cae-101b77c3b975 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:37:16.031725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ccf67a99-f7d8-4d7c-9cae-101b77c3b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:16.099316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf67a99-f7d8-4d7c-9cae-101b77c3b975 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:37:16.103199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9808ebc-7257-4d66-b787-715958c64e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:37:16.103855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808ebc-7257-4d66-b787-715958c64e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:16.104138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808ebc-7257-4d66-b787-715958c64e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:16.104419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9808ebc-7257-4d66-b787-715958c64e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:16.115224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9808ebc-7257-4d66-b787-715958c64e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:37:16.116711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9808ebc-7257-4d66-b787-715958c64e71 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:37:16.128333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 770/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:37:18.456212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b4a64-f2ac-45f1-b5d8-32d2c907092c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:18.456987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b4a64-f2ac-45f1-b5d8-32d2c907092c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:18.456987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b4a64-f2ac-45f1-b5d8-32d2c907092c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:18.458641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:37:18.465658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eeb2f-a240-4578-9bf0-753e5fcbfe6d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:18.466246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eeb2f-a240-4578-9bf0-753e5fcbfe6d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:18.466483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eeb2f-a240-4578-9bf0-753e5fcbfe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:18.500326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f97eeb2f-a240-4578-9bf0-753e5fcbfe6d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:37:18.502519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f97eeb2f-a240-4578-9bf0-753e5fcbfe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:18.516799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:37:18.811921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b4a64-f2ac-45f1-b5d8-32d2c907092c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:37:18.823804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b4a64-f2ac-45f1-b5d8-32d2c907092c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:37:18.827823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52468-2f46-4a48-8687-eb0f482dfbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:37:18.828446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52468-2f46-4a48-8687-eb0f482dfbaf service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:18.828737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52468-2f46-4a48-8687-eb0f482dfbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:18.829015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52468-2f46-4a48-8687-eb0f482dfbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:18.839219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52468-2f46-4a48-8687-eb0f482dfbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:37:18.840686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f52468-2f46-4a48-8687-eb0f482dfbaf service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:37:18.852411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 762/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:37:22.713656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510311-b981-4a67-85ae-72930d02ef3e None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:22.714277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510311-b981-4a67-85ae-72930d02ef3e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:22.714277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510311-b981-4a67-85ae-72930d02ef3e None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:22.715946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:37:22.721963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb15eb-e580-4e02-a72f-196264731f3f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:22.722454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb15eb-e580-4e02-a72f-196264731f3f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:22.722557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb15eb-e580-4e02-a72f-196264731f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:22.730267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:37:22.744673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-edbb15eb-e580-4e02-a72f-196264731f3f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:37:22.745934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-edbb15eb-e580-4e02-a72f-196264731f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:22.754629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:37:23.066718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510311-b981-4a67-85ae-72930d02ef3e None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:37:23.069578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ee510311-b981-4a67-85ae-72930d02ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:23.076477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:37:23.141036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510311-b981-4a67-85ae-72930d02ef3e None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:37:23.145092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311059c-5c92-445b-a4c5-04a47ab4708d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:37:23.145753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311059c-5c92-445b-a4c5-04a47ab4708d service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:23.146035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311059c-5c92-445b-a4c5-04a47ab4708d service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:23.146313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311059c-5c92-445b-a4c5-04a47ab4708d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:23.156874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311059c-5c92-445b-a4c5-04a47ab4708d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:37:23.158369 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311059c-5c92-445b-a4c5-04a47ab4708d service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:37:23.168930 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 773/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:37:25.445825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d810-f72a-45c7-920a-da5dcf0ed36b None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:25.446553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d810-f72a-45c7-920a-da5dcf0ed36b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:25.446553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d810-f72a-45c7-920a-da5dcf0ed36b None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:25.447714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 3 12:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:37:25.454534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064d18d-8151-4030-91fd-a5d346923e80 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:25.455456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064d18d-8151-4030-91fd-a5d346923e80 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:25.455456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064d18d-8151-4030-91fd-a5d346923e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:25.477688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f064d18d-8151-4030-91fd-a5d346923e80 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:37:25.478967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f064d18d-8151-4030-91fd-a5d346923e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:25.487327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 3 12:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:37:25.801048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55d810-f72a-45c7-920a-da5dcf0ed36b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:37:25.802881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7a55d810-f72a-45c7-920a-da5dcf0ed36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:37:25.817367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55d810-f72a-45c7-920a-da5dcf0ed36b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:37:25.821207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb549e-f6ed-4057-850b-01692763eb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:37:25.821881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb549e-f6ed-4057-850b-01692763eb70 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:37:25.822166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb549e-f6ed-4057-850b-01692763eb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:37:25.822444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb549e-f6ed-4057-850b-01692763eb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:37:25.832851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb549e-f6ed-4057-850b-01692763eb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:37:25.834359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb549e-f6ed-4057-850b-01692763eb70 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:37:25.845700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 765/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:37:35.472073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=28 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:37:35.840419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=8 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:03.045639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc000-e9c3-4ff6-a597-30ce491422fe None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.046319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc000-e9c3-4ff6-a597-30ce491422fe None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.046319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bc000-e9c3-4ff6-a597-30ce491422fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.074731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-040bc000-e9c3-4ff6-a597-30ce491422fe None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:03.076127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-040bc000-e9c3-4ff6-a597-30ce491422fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:03.084855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 775/1540] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:03.094390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe67a-b289-440d-8164-9f1b4c63c730 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.095021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe67a-b289-440d-8164-9f1b4c63c730 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.095021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe67a-b289-440d-8164-9f1b4c63c730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.126928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-525fe67a-b289-440d-8164-9f1b4c63c730 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:03.128202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-525fe67a-b289-440d-8164-9f1b4c63c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:03.139150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 766/1541] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:03.143737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bc000-e9c3-4ff6-a597-30ce491422fe None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:03.156047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bc000-e9c3-4ff6-a597-30ce491422fe None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:03.163777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c2c2f-c479-41bc-9a69-e16f4b0df08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:03.164867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2c2f-c479-41bc-9a69-e16f4b0df08e admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.165334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2c2f-c479-41bc-9a69-e16f4b0df08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.165826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c2c2f-c479-41bc-9a69-e16f4b0df08e admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.166763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c2c2f-c479-41bc-9a69-e16f4b0df08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:03.167263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c2c2f-c479-41bc-9a69-e16f4b0df08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:03.168595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING py.warnings [None req-d88c2c2f-c479-41bc-9a69-e16f4b0df08e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:39:03.168595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: warnings.warn(msg) Oct 03 12:39:03.168595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: Oct 03 12:39:03.170217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c2c2f-c479-41bc-9a69-e16f4b0df08e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:03.189108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 776/1542] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:03.198673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fe67a-b289-440d-8164-9f1b4c63c730 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:03.220527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fe67a-b289-440d-8164-9f1b4c63c730 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:03.231806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:03.232484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.232771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.233230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.233742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:03.234792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:39:03.234792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: warnings.warn(msg) Oct 03 12:39:03.234792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: Oct 03 12:39:03.236193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:03.287986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 767/1543] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:03.288751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827df93-1477-405d-8acf-9cda69e35129 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.289224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827df93-1477-405d-8acf-9cda69e35129 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.289710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827df93-1477-405d-8acf-9cda69e35129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.302527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:03.339985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3827df93-1477-405d-8acf-9cda69e35129 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:03.341253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3827df93-1477-405d-8acf-9cda69e35129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:03.448892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e314-656d-49ac-bdd1-89ef728d3e57 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:03.467297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6da21a-4d3c-4472-bb16-b5669f734972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:03.467973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da21a-4d3c-4472-bb16-b5669f734972 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.468264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da21a-4d3c-4472-bb16-b5669f734972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.468546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6da21a-4d3c-4472-bb16-b5669f734972 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.469229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6da21a-4d3c-4472-bb16-b5669f734972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:03.471500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6da21a-4d3c-4472-bb16-b5669f734972 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:03.528034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 777/1544] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:03.532206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 768/1545] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:39:03.537683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827df93-1477-405d-8acf-9cda69e35129 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:03.539871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae34e-4dc2-4bd3-8823-a871613b7f84 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.540159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae34e-4dc2-4bd3-8823-a871613b7f84 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.540440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ae34e-4dc2-4bd3-8823-a871613b7f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.569092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827df93-1477-405d-8acf-9cda69e35129 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:03.586736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-861ae34e-4dc2-4bd3-8823-a871613b7f84 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:03.588237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-861ae34e-4dc2-4bd3-8823-a871613b7f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:03.590667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04741e-9669-4899-802e-4415188e434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:03.592155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04741e-9669-4899-802e-4415188e434c admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.592961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04741e-9669-4899-802e-4415188e434c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.597754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04741e-9669-4899-802e-4415188e434c admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.599543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04741e-9669-4899-802e-4415188e434c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:03.603129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04741e-9669-4899-802e-4415188e434c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:03.620150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 769/1546] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:03.632182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae34e-4dc2-4bd3-8823-a871613b7f84 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:03.646628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 778/1547] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:03.652920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f52ca-911c-4180-ae12-7189efeb925f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.653582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f52ca-911c-4180-ae12-7189efeb925f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.654132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f52ca-911c-4180-ae12-7189efeb925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.658335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ae34e-4dc2-4bd3-8823-a871613b7f84 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:03.670239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:03.670974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.671264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.671544 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.672225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:03.672553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:03.681006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:03.697883 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-984f52ca-911c-4180-ae12-7189efeb925f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:03.697883 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-984f52ca-911c-4180-ae12-7189efeb925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:03.703175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 770/1548] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:03.704119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:03.724193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21aca2-947a-46de-ac44-7ced3a13f3cd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:03.729417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd2e6a-ec57-436e-8d41-56d6855f9561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:03.730326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd2e6a-ec57-436e-8d41-56d6855f9561 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.730773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd2e6a-ec57-436e-8d41-56d6855f9561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.731061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd2e6a-ec57-436e-8d41-56d6855f9561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.731727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd2e6a-ec57-436e-8d41-56d6855f9561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:03.733443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd2e6a-ec57-436e-8d41-56d6855f9561 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:03.735402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 779/1549] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:03.736829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba1cf-d84d-42d3-a4bb-f81c26910a4f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.737626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba1cf-d84d-42d3-a4bb-f81c26910a4f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.737913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba1cf-d84d-42d3-a4bb-f81c26910a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.752325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 771/1550] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:03.753163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd2e6a-ec57-436e-8d41-56d6855f9561 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:03.778114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd2e6a-ec57-436e-8d41-56d6855f9561 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:03.789449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-455ba1cf-d84d-42d3-a4bb-f81c26910a4f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:03.790226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30e2a0-5f8b-4ec6-941f-ce7832cc24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:03.791380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-455ba1cf-d84d-42d3-a4bb-f81c26910a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:03.791577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30e2a0-5f8b-4ec6-941f-ce7832cc24d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.792017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30e2a0-5f8b-4ec6-941f-ce7832cc24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.792846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30e2a0-5f8b-4ec6-941f-ce7832cc24d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.794208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30e2a0-5f8b-4ec6-941f-ce7832cc24d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:03.797897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30e2a0-5f8b-4ec6-941f-ce7832cc24d7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:03.801345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 780/1551] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:03.802959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421f95f-3bdb-4a87-9ccd-12f5b2dc4a5b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.803439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421f95f-3bdb-4a87-9ccd-12f5b2dc4a5b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.803891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421f95f-3bdb-4a87-9ccd-12f5b2dc4a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.841491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f421f95f-3bdb-4a87-9ccd-12f5b2dc4a5b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:03.843476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 772/1552] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:03.844426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f421f95f-3bdb-4a87-9ccd-12f5b2dc4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:03.844945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426729f-40d8-411a-83dc-000d4d3899aa None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.845311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426729f-40d8-411a-83dc-000d4d3899aa None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.845712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426729f-40d8-411a-83dc-000d4d3899aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.874861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3426729f-40d8-411a-83dc-000d4d3899aa None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:03.876210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3426729f-40d8-411a-83dc-000d4d3899aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:03.955178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 773/1553] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:03.958339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426729f-40d8-411a-83dc-000d4d3899aa None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:03.966548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426729f-40d8-411a-83dc-000d4d3899aa None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:03.971795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:03.972485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.972764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.973037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] PATH_INFO: `/v3/projects/8505f5715a1140549d5537f9b2c2bee7/users/80e164ab4bd144579990dd67cb739666/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.977115 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:03.977357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 781/1554] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:03.979329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122f1d-b798-4085-8cb8-409a7757103c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:03.979622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122f1d-b798-4085-8cb8-409a7757103c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:03.979897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd122f1d-b798-4085-8cb8-409a7757103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:03.994014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8505f5715a1140549d5537f9b2c2bee7, user_id=80e164ab4bd144579990dd67cb739666, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:03.996944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:39:03.996944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: warnings.warn(msg) Oct 03 12:39:03.996944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: Oct 03 12:39:03.999688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.002900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-cd122f1d-b798-4085-8cb8-409a7757103c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.004147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-cd122f1d-b798-4085-8cb8-409a7757103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.016892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 782/1555] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.019146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d807ba3-e7e3-40af-9312-38b6476f0ddd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.019739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d807ba3-e7e3-40af-9312-38b6476f0ddd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.020261 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d807ba3-e7e3-40af-9312-38b6476f0ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.029868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 774/1556] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:03 2022] PUT /identity/v3/projects/8505f5715a1140549d5537f9b2c2bee7/users/80e164ab4bd144579990dd67cb739666/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:04.029868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.049797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6d807ba3-e7e3-40af-9312-38b6476f0ddd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.051030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6d807ba3-e7e3-40af-9312-38b6476f0ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.107486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294a09-ca57-4c47-9b17-ffe0a3fc2148 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.112155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ea0a0-5e75-41c3-99b7-5b1553b3d733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.112813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea0a0-5e75-41c3-99b7-5b1553b3d733 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.113092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea0a0-5e75-41c3-99b7-5b1553b3d733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.113368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ea0a0-5e75-41c3-99b7-5b1553b3d733 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.113727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:04.114044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ea0a0-5e75-41c3-99b7-5b1553b3d733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.116246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ea0a0-5e75-41c3-99b7-5b1553b3d733 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.133308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 783/1557] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.134637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd136-afbf-40f4-bc22-28dd3704f39f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.134944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd136-afbf-40f4-bc22-28dd3704f39f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.135222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd136-afbf-40f4-bc22-28dd3704f39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.147758 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 775/1558] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.152432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546093e0-aecf-4f13-a433-1435eba7b711 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.153006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546093e0-aecf-4f13-a433-1435eba7b711 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.153006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546093e0-aecf-4f13-a433-1435eba7b711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.158077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-316bd136-afbf-40f4-bc22-28dd3704f39f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.159317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-316bd136-afbf-40f4-bc22-28dd3704f39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.172676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 784/1559] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.173252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-546093e0-aecf-4f13-a433-1435eba7b711 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.174197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd136-afbf-40f4-bc22-28dd3704f39f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.174525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-546093e0-aecf-4f13-a433-1435eba7b711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.188560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 776/1560] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.190117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0a29c-8ad4-4e2a-858e-228f1eb82d8e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.190411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0a29c-8ad4-4e2a-858e-228f1eb82d8e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.190679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0a29c-8ad4-4e2a-858e-228f1eb82d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.198793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd136-afbf-40f4-bc22-28dd3704f39f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.208577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660965e-7e81-4f71-ae04-a16864617a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.209715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660965e-7e81-4f71-ae04-a16864617a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.210224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660965e-7e81-4f71-ae04-a16864617a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.210729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660965e-7e81-4f71-ae04-a16864617a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.211957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660965e-7e81-4f71-ae04-a16864617a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:04.212507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660965e-7e81-4f71-ae04-a16864617a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.213560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6bc0a29c-8ad4-4e2a-858e-228f1eb82d8e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.214781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6bc0a29c-8ad4-4e2a-858e-228f1eb82d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.215742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660965e-7e81-4f71-ae04-a16864617a31 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.222994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 777/1561] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.224273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14057-82d6-49d1-98d4-fbcb7c982bad None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.224562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14057-82d6-49d1-98d4-fbcb7c982bad None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.224831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14057-82d6-49d1-98d4-fbcb7c982bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.238301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 785/1562] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:04.240432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d924f1-23c8-40a4-a27f-2347315b8d23 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.240936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d924f1-23c8-40a4-a27f-2347315b8d23 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.241434 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d924f1-23c8-40a4-a27f-2347315b8d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.246446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1df14057-82d6-49d1-98d4-fbcb7c982bad None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.247702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1df14057-82d6-49d1-98d4-fbcb7c982bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.256231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 778/1563] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.257088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14057-82d6-49d1-98d4-fbcb7c982bad None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.272413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14057-82d6-49d1-98d4-fbcb7c982bad None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.277959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.278581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.278877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.279105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.279265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-75d924f1-23c8-40a4-a27f-2347315b8d23 None None] MFA Rules not processed for user `80e164ab4bd144579990dd67cb739666`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.279759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:04.280088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.280511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-75d924f1-23c8-40a4-a27f-2347315b8d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.281869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.295918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 779/1564] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:04.297206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.307529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97845a1b-c2ac-4cf5-9567-dbaa61195c29 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.317473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3dd80-bd26-4da1-a3bd-70851a9be1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.318147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3dd80-bd26-4da1-a3bd-70851a9be1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.318432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3dd80-bd26-4da1-a3bd-70851a9be1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.318711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3dd80-bd26-4da1-a3bd-70851a9be1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.319356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3dd80-bd26-4da1-a3bd-70851a9be1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.320985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3dd80-bd26-4da1-a3bd-70851a9be1f5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.332084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 780/1565] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:04.333203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9675db-f1c3-4b2b-b960-dc3b758f4cd7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.333551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9675db-f1c3-4b2b-b960-dc3b758f4cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.333840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9675db-f1c3-4b2b-b960-dc3b758f4cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.355445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-5d9675db-f1c3-4b2b-b960-dc3b758f4cd7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.356674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5d9675db-f1c3-4b2b-b960-dc3b758f4cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.365100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 781/1566] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.366385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7407c-4ce0-4076-ac4e-d5bb965c1222 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.366671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7407c-4ce0-4076-ac4e-d5bb965c1222 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.366846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 786/1567] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.367018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7407c-4ce0-4076-ac4e-d5bb965c1222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.367729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d924f1-23c8-40a4-a27f-2347315b8d23 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.384365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d924f1-23c8-40a4-a27f-2347315b8d23 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.389722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.390511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.390915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.391202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-83c7407c-4ce0-4076-ac4e-d5bb965c1222 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:04.391365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.392134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:04.392450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.393160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-83c7407c-4ce0-4076-ac4e-d5bb965c1222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:04.394119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.402629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 782/1568] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:04.403588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7407c-4ce0-4076-ac4e-d5bb965c1222 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.417796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 787/1569] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:04.417796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.420602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7407c-4ce0-4076-ac4e-d5bb965c1222 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.422202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcdc83-e277-40bd-bd08-e2c844f97c71 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.426881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.427326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d039-878c-412f-9e37-8124c47ffc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.427515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.427763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.428040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.428252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d039-878c-412f-9e37-8124c47ffc3f admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.428683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d039-878c-412f-9e37-8124c47ffc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.429673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:04.429673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.430014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0d039-878c-412f-9e37-8124c47ffc3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.430313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0d039-878c-412f-9e37-8124c47ffc3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.430661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.432841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0d039-878c-412f-9e37-8124c47ffc3f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.444300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 788/1570] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:04.446316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.459033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e625f-4b8e-46e4-b385-24b8fd0d18fa admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.464653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8242222-bb24-419c-9c8b-16a3f5a36474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.465276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242222-bb24-419c-9c8b-16a3f5a36474 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.465597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242222-bb24-419c-9c8b-16a3f5a36474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.465875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242222-bb24-419c-9c8b-16a3f5a36474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.466516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8242222-bb24-419c-9c8b-16a3f5a36474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.468451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8242222-bb24-419c-9c8b-16a3f5a36474 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.471727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 783/1571] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.471727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d039-878c-412f-9e37-8124c47ffc3f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.510040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 789/1572] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.511629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8242222-bb24-419c-9c8b-16a3f5a36474 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.554549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:04.563013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0d039-878c-412f-9e37-8124c47ffc3f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.597731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8242222-bb24-419c-9c8b-16a3f5a36474 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.602950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.604126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.604421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.604701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.605361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:04.605710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.607332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.619419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 790/1573] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:04.620168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.628621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e0fe-28c8-450a-a5e7-aada0b8ce57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.629342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e0fe-28c8-450a-a5e7-aada0b8ce57f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.629670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e0fe-28c8-450a-a5e7-aada0b8ce57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.629953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e0fe-28c8-450a-a5e7-aada0b8ce57f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.630608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1e0fe-28c8-450a-a5e7-aada0b8ce57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.631307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a326607-fdf7-483f-b570-6469c4ae2dd6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.632292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1e0fe-28c8-450a-a5e7-aada0b8ce57f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.636894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f26da8-07fa-4101-9c60-e21dace0e956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.637502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26da8-07fa-4101-9c60-e21dace0e956 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.637811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26da8-07fa-4101-9c60-e21dace0e956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.638084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26da8-07fa-4101-9c60-e21dace0e956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.638724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f26da8-07fa-4101-9c60-e21dace0e956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.640620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f26da8-07fa-4101-9c60-e21dace0e956 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.643559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 784/1574] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:04.644465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e0fe-28c8-450a-a5e7-aada0b8ce57f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.645300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:04.657356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e0fe-28c8-450a-a5e7-aada0b8ce57f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.663148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.664153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.667844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.667844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.667844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:04.667844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.667844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.676904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 791/1575] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.676904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f26da8-07fa-4101-9c60-e21dace0e956 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.680646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 785/1576] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:04.681482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.692210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c017b67-573e-40b5-ba3e-babac4a8716e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.755258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f26da8-07fa-4101-9c60-e21dace0e956 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.758548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cf09c-8497-4671-8ced-859d8aea996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.759453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cf09c-8497-4671-8ced-859d8aea996f admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.760227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cf09c-8497-4671-8ced-859d8aea996f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.760502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cf09c-8497-4671-8ced-859d8aea996f admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.760831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d4b2-52b3-4ccc-b993-9f1f4792f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.761142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cf09c-8497-4671-8ced-859d8aea996f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.761472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d4b2-52b3-4ccc-b993-9f1f4792f27e admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.761858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d4b2-52b3-4ccc-b993-9f1f4792f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.762187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d4b2-52b3-4ccc-b993-9f1f4792f27e admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.762871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80d4b2-52b3-4ccc-b993-9f1f4792f27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.763267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cf09c-8497-4671-8ced-859d8aea996f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.764787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80d4b2-52b3-4ccc-b993-9f1f4792f27e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.791578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 786/1577] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.792398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cf09c-8497-4671-8ced-859d8aea996f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.797585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 792/1578] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.798342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d4b2-52b3-4ccc-b993-9f1f4792f27e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.859169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cf09c-8497-4671-8ced-859d8aea996f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.861351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80d4b2-52b3-4ccc-b993-9f1f4792f27e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.864429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aceb8-0d8e-404c-b503-47fb7cd2070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.865101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aceb8-0d8e-404c-b503-47fb7cd2070d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.865382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aceb8-0d8e-404c-b503-47fb7cd2070d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.865749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8aceb8-0d8e-404c-b503-47fb7cd2070d admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.866282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.866438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aceb8-0d8e-404c-b503-47fb7cd2070d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.866866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.867139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.867415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.868038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.868361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8aceb8-0d8e-404c-b503-47fb7cd2070d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.869066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING py.warnings [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:39:04.869066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: warnings.warn(msg) Oct 03 12:39:04.869066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: Oct 03 12:39:04.870349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.887243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:04.893201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 793/1579] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.893945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 787/1580] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.894061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.895117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aceb8-0d8e-404c-b503-47fb7cd2070d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.906573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb2d30-c00e-4aac-b12f-ba46c5ff6c90 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.908104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8aceb8-0d8e-404c-b503-47fb7cd2070d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:04.911288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bde7-c76a-4962-989e-ebe07199e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.911909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bde7-c76a-4962-989e-ebe07199e802 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.912193 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bde7-c76a-4962-989e-ebe07199e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.912472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4bde7-c76a-4962-989e-ebe07199e802 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.912973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1330c0-6527-4c1a-a0ac-f392550ecff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:04.913145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4bde7-c76a-4962-989e-ebe07199e802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.913821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1330c0-6527-4c1a-a0ac-f392550ecff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:04.914197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1330c0-6527-4c1a-a0ac-f392550ecff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:04.914650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1330c0-6527-4c1a-a0ac-f392550ecff1 admin admin] PATH_INFO: `/v3/projects/2dea551121ae4414bf931a3d2e822c0f/users/3e8d771d7cda42ffae0a2beb5fb51727/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:04.915106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4bde7-c76a-4962-989e-ebe07199e802 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.931033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1330c0-6527-4c1a-a0ac-f392550ecff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dea551121ae4414bf931a3d2e822c0f, user_id=3e8d771d7cda42ffae0a2beb5fb51727, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:04.933718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1330c0-6527-4c1a-a0ac-f392550ecff1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:04.948993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 794/1581] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:04.948993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bde7-c76a-4962-989e-ebe07199e802 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.949282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 788/1582] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:04 2022] PUT /identity/v3/projects/2dea551121ae4414bf931a3d2e822c0f/users/3e8d771d7cda42ffae0a2beb5fb51727/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:04.958436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1330c0-6527-4c1a-a0ac-f392550ecff1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:04.992279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:05.016536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4bde7-c76a-4962-989e-ebe07199e802 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.023410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1330c0-6527-4c1a-a0ac-f392550ecff1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.023891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954338db-9494-46b4-9da3-77643c1ba817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.024514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954338db-9494-46b4-9da3-77643c1ba817 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.024805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954338db-9494-46b4-9da3-77643c1ba817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.025079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954338db-9494-46b4-9da3-77643c1ba817 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.026359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954338db-9494-46b4-9da3-77643c1ba817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.028232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954338db-9494-46b4-9da3-77643c1ba817 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.030011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7c9ad-0add-487f-8805-0f582b610e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.030908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c9ad-0add-487f-8805-0f582b610e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.031336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c9ad-0add-487f-8805-0f582b610e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.031747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7c9ad-0add-487f-8805-0f582b610e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.032721 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7c9ad-0add-487f-8805-0f582b610e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.036126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7c9ad-0add-487f-8805-0f582b610e0d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.051499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 795/1583] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:05.052255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954338db-9494-46b4-9da3-77643c1ba817 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.063111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954338db-9494-46b4-9da3-77643c1ba817 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.069122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c0848-96fe-4487-8fb9-dde494aca0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.073716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0848-96fe-4487-8fb9-dde494aca0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.073857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 789/1584] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:04 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:05.073988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0848-96fe-4487-8fb9-dde494aca0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.073988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0848-96fe-4487-8fb9-dde494aca0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.074169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7c9ad-0add-487f-8805-0f582b610e0d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.074486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c0848-96fe-4487-8fb9-dde494aca0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.075530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c0848-96fe-4487-8fb9-dde494aca0d5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.104267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 796/1585] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/users => generated 302 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:05.105111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c0848-96fe-4487-8fb9-dde494aca0d5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.114945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c0848-96fe-4487-8fb9-dde494aca0d5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.139862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7c9ad-0add-487f-8805-0f582b610e0d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.144503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e4da-a4aa-4d48-b246-221d1fe37d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.145387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e4da-a4aa-4d48-b246-221d1fe37d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.145703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e4da-a4aa-4d48-b246-221d1fe37d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.145971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e4da-a4aa-4d48-b246-221d1fe37d64 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.146599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8e4da-a4aa-4d48-b246-221d1fe37d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.148500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8e4da-a4aa-4d48-b246-221d1fe37d64 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.170104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 790/1586] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:05.170965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e4da-a4aa-4d48-b246-221d1fe37d64 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.176081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d88180-8598-45b2-9c50-09c77dcf44d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.176933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88180-8598-45b2-9c50-09c77dcf44d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.177218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88180-8598-45b2-9c50-09c77dcf44d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.177507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88180-8598-45b2-9c50-09c77dcf44d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.178205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d88180-8598-45b2-9c50-09c77dcf44d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.179851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d88180-8598-45b2-9c50-09c77dcf44d4 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.181041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e4da-a4aa-4d48-b246-221d1fe37d64 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.186208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16435a9d-ad76-4959-ac49-17b1fb9d78ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.186833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16435a9d-ad76-4959-ac49-17b1fb9d78ae admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.187099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16435a9d-ad76-4959-ac49-17b1fb9d78ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.187373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16435a9d-ad76-4959-ac49-17b1fb9d78ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.188008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16435a9d-ad76-4959-ac49-17b1fb9d78ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.189617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16435a9d-ad76-4959-ac49-17b1fb9d78ae admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.191290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 797/1587] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.192335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d88180-8598-45b2-9c50-09c77dcf44d4 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.201394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 791/1588] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.202591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fc218-d17b-446a-b144-80cb10f0f0bf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.202872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fc218-d17b-446a-b144-80cb10f0f0bf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.203140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fc218-d17b-446a-b144-80cb10f0f0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.203637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d88180-8598-45b2-9c50-09c77dcf44d4 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.208511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7ab1-ba92-47f1-92fc-de907b2f346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.209114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7ab1-ba92-47f1-92fc-de907b2f346f admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.209395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7ab1-ba92-47f1-92fc-de907b2f346f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.209714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc7ab1-ba92-47f1-92fc-de907b2f346f admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.210342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc7ab1-ba92-47f1-92fc-de907b2f346f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.212300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc7ab1-ba92-47f1-92fc-de907b2f346f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.231979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-617fc218-d17b-446a-b144-80cb10f0f0bf None None] MFA Rules not processed for user `3e8d771d7cda42ffae0a2beb5fb51727`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:05.233860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-617fc218-d17b-446a-b144-80cb10f0f0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:05.237881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 798/1589] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:05.237881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7ab1-ba92-47f1-92fc-de907b2f346f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.246796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc7ab1-ba92-47f1-92fc-de907b2f346f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.253090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f63d-0df7-4ace-911d-49f6df524e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.253862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f63d-0df7-4ace-911d-49f6df524e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.254151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f63d-0df7-4ace-911d-49f6df524e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.254427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882f63d-0df7-4ace-911d-49f6df524e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.255082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882f63d-0df7-4ace-911d-49f6df524e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.256676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882f63d-0df7-4ace-911d-49f6df524e30 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.265497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:05.268138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 799/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.268984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f63d-0df7-4ace-911d-49f6df524e30 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.278938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882f63d-0df7-4ace-911d-49f6df524e30 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.283703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22255-c672-457a-b600-7bc8974b63b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.284221 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22255-c672-457a-b600-7bc8974b63b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.284502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22255-c672-457a-b600-7bc8974b63b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.284781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d22255-c672-457a-b600-7bc8974b63b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.285404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d22255-c672-457a-b600-7bc8974b63b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.287359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d22255-c672-457a-b600-7bc8974b63b4 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.305031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 792/1591] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:05.305934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fc218-d17b-446a-b144-80cb10f0f0bf None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.314503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 800/1592] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:05.314503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22255-c672-457a-b600-7bc8974b63b4 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.320873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fc218-d17b-446a-b144-80cb10f0f0bf None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.324282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d22255-c672-457a-b600-7bc8974b63b4 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.326577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6da0a-6db9-440c-ab87-bd2e740af194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.327188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6da0a-6db9-440c-ab87-bd2e740af194 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.327501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6da0a-6db9-440c-ab87-bd2e740af194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.327800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6da0a-6db9-440c-ab87-bd2e740af194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.328465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6da0a-6db9-440c-ab87-bd2e740af194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.328950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926911c-bba6-40f4-93c8-13f58f6ed620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.329568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926911c-bba6-40f4-93c8-13f58f6ed620 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.329857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926911c-bba6-40f4-93c8-13f58f6ed620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.330122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6da0a-6db9-440c-ab87-bd2e740af194 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.330239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926911c-bba6-40f4-93c8-13f58f6ed620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.330755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926911c-bba6-40f4-93c8-13f58f6ed620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.332379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926911c-bba6-40f4-93c8-13f58f6ed620 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.341369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 793/1593] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.342210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6da0a-6db9-440c-ab87-bd2e740af194 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.342385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 801/1594] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.343144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926911c-bba6-40f4-93c8-13f58f6ed620 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.351898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6da0a-6db9-440c-ab87-bd2e740af194 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.352807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926911c-bba6-40f4-93c8-13f58f6ed620 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.357683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebda0b-c49d-4a37-bc7f-6a717c65a4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.358359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebda0b-c49d-4a37-bc7f-6a717c65a4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.358711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebda0b-c49d-4a37-bc7f-6a717c65a4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.359050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebda0b-c49d-4a37-bc7f-6a717c65a4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.359159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95465d7a-91a8-43b8-b16f-90002dc8f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.359822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebda0b-c49d-4a37-bc7f-6a717c65a4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.359932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d7a-91a8-43b8-b16f-90002dc8f14f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.360229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d7a-91a8-43b8-b16f-90002dc8f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.360506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95465d7a-91a8-43b8-b16f-90002dc8f14f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.361197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95465d7a-91a8-43b8-b16f-90002dc8f14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.361783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebda0b-c49d-4a37-bc7f-6a717c65a4bf admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.363609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95465d7a-91a8-43b8-b16f-90002dc8f14f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.373185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 802/1595] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.374166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebda0b-c49d-4a37-bc7f-6a717c65a4bf admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.375187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 794/1596] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.376002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95465d7a-91a8-43b8-b16f-90002dc8f14f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.389231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95465d7a-91a8-43b8-b16f-90002dc8f14f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.390265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebda0b-c49d-4a37-bc7f-6a717c65a4bf admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.394770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6596-e444-4f32-b9d5-2de374acdb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.395474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6596-e444-4f32-b9d5-2de374acdb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.395752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6596-e444-4f32-b9d5-2de374acdb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.396036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb6596-e444-4f32-b9d5-2de374acdb15 admin admin] PATH_INFO: `/v3/projects/9f9a6b60ca2a416181906189f13b49a8/users/1f8084bdf774417080410db0a7979273/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.396743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c65d02-9e5b-46b1-9977-aef9de2b0ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.397952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65d02-9e5b-46b1-9977-aef9de2b0ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.398318 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65d02-9e5b-46b1-9977-aef9de2b0ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.398692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65d02-9e5b-46b1-9977-aef9de2b0ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.399496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c65d02-9e5b-46b1-9977-aef9de2b0ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.401272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c65d02-9e5b-46b1-9977-aef9de2b0ffd admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.412208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb6596-e444-4f32-b9d5-2de374acdb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9a6b60ca2a416181906189f13b49a8, user_id=1f8084bdf774417080410db0a7979273, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.413784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 803/1597] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.415252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c65d02-9e5b-46b1-9977-aef9de2b0ffd admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.415416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb6596-e444-4f32-b9d5-2de374acdb15 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.428438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c65d02-9e5b-46b1-9977-aef9de2b0ffd admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.433029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 795/1598] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:05 2022] PUT /identity/v3/projects/9f9a6b60ca2a416181906189f13b49a8/users/1f8084bdf774417080410db0a7979273/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:05.433883 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6596-e444-4f32-b9d5-2de374acdb15 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.460175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:05.497681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45b8be-b191-4729-aefc-948496057940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.498297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b8be-b191-4729-aefc-948496057940 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.498579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b8be-b191-4729-aefc-948496057940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.498852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b8be-b191-4729-aefc-948496057940 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.499540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45b8be-b191-4729-aefc-948496057940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.499693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb6596-e444-4f32-b9d5-2de374acdb15 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.501458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45b8be-b191-4729-aefc-948496057940 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.504356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369306ed-289a-4d7c-a49d-9dd96663891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.504965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369306ed-289a-4d7c-a49d-9dd96663891f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.505241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369306ed-289a-4d7c-a49d-9dd96663891f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.505530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369306ed-289a-4d7c-a49d-9dd96663891f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.506184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369306ed-289a-4d7c-a49d-9dd96663891f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.507772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369306ed-289a-4d7c-a49d-9dd96663891f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.521579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 796/1599] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.521579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369306ed-289a-4d7c-a49d-9dd96663891f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.529629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369306ed-289a-4d7c-a49d-9dd96663891f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.534915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0121e7-8544-489c-9b4b-31d8275f498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.535538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0121e7-8544-489c-9b4b-31d8275f498e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.535792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 804/1600] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:05.535971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0121e7-8544-489c-9b4b-31d8275f498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.536159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0121e7-8544-489c-9b4b-31d8275f498e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.536702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0121e7-8544-489c-9b4b-31d8275f498e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.536869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45b8be-b191-4729-aefc-948496057940 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.538355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0121e7-8544-489c-9b4b-31d8275f498e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.550346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 797/1601] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.553739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0121e7-8544-489c-9b4b-31d8275f498e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.561962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0121e7-8544-489c-9b4b-31d8275f498e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.613083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45b8be-b191-4729-aefc-948496057940 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.618479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb473-0e42-4460-8e37-3dc486619443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.618651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb473-0e42-4460-8e37-3dc486619443 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.618782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb473-0e42-4460-8e37-3dc486619443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.619170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fb473-0e42-4460-8e37-3dc486619443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.620234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746cbb4-a1c0-4094-b03f-263034744db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.620383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fb473-0e42-4460-8e37-3dc486619443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.620890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746cbb4-a1c0-4094-b03f-263034744db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.621169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746cbb4-a1c0-4094-b03f-263034744db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.621446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746cbb4-a1c0-4094-b03f-263034744db5 admin admin] PATH_INFO: `/v3/projects/8755b2039e084a809de0fa8804d8a1aa/users/885ef3fa3d4d4f80be21660f52809565/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.621971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fb473-0e42-4460-8e37-3dc486619443 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.632612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 805/1602] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.633466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb473-0e42-4460-8e37-3dc486619443 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.637443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:05.640971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746cbb4-a1c0-4094-b03f-263034744db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8755b2039e084a809de0fa8804d8a1aa, user_id=885ef3fa3d4d4f80be21660f52809565, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.643949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746cbb4-a1c0-4094-b03f-263034744db5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.644102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fb473-0e42-4460-8e37-3dc486619443 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.649351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d6e04-2bd9-4f72-b979-ae8600ac15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.649979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d6e04-2bd9-4f72-b979-ae8600ac15be admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.650295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d6e04-2bd9-4f72-b979-ae8600ac15be admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.650656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d6e04-2bd9-4f72-b979-ae8600ac15be admin admin] PATH_INFO: `/v3/projects/bb3d5847068a4bdd8006cdc198c7159c/users/a76145d9b91d477cb13d499eccff90d6/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.660424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 798/1603] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:05 2022] PUT /identity/v3/projects/8755b2039e084a809de0fa8804d8a1aa/users/885ef3fa3d4d4f80be21660f52809565/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:05.661177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746cbb4-a1c0-4094-b03f-263034744db5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.672100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d6e04-2bd9-4f72-b979-ae8600ac15be admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3d5847068a4bdd8006cdc198c7159c, user_id=a76145d9b91d477cb13d499eccff90d6, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.674893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d6e04-2bd9-4f72-b979-ae8600ac15be admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.691116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 806/1604] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:05 2022] PUT /identity/v3/projects/bb3d5847068a4bdd8006cdc198c7159c/users/a76145d9b91d477cb13d499eccff90d6/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:05.691116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d6e04-2bd9-4f72-b979-ae8600ac15be admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.732089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746cbb4-a1c0-4094-b03f-263034744db5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.790154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d6e04-2bd9-4f72-b979-ae8600ac15be admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.798335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545a57-4626-4392-9dc1-ed1c227dc5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.799553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545a57-4626-4392-9dc1-ed1c227dc5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.800090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545a57-4626-4392-9dc1-ed1c227dc5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.800623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545a57-4626-4392-9dc1-ed1c227dc5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.801887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7545a57-4626-4392-9dc1-ed1c227dc5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.803903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409450ea-bfae-413d-9d6f-42b04abae1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.804638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409450ea-bfae-413d-9d6f-42b04abae1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.804817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7545a57-4626-4392-9dc1-ed1c227dc5a6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.805073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409450ea-bfae-413d-9d6f-42b04abae1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.805468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409450ea-bfae-413d-9d6f-42b04abae1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.806227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409450ea-bfae-413d-9d6f-42b04abae1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.807929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409450ea-bfae-413d-9d6f-42b04abae1e0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.825149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 807/1605] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.825149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545a57-4626-4392-9dc1-ed1c227dc5a6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.825581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 799/1606] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.825581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409450ea-bfae-413d-9d6f-42b04abae1e0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.838425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545a57-4626-4392-9dc1-ed1c227dc5a6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.839465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409450ea-bfae-413d-9d6f-42b04abae1e0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.844667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76361-8cf3-4440-a9ca-938a649e8c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.845400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76361-8cf3-4440-a9ca-938a649e8c24 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.845780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76361-8cf3-4440-a9ca-938a649e8c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.846135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76361-8cf3-4440-a9ca-938a649e8c24 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.846884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f76361-8cf3-4440-a9ca-938a649e8c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.848467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb24e-b46b-4e07-bda2-8195ac13fb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.848914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f76361-8cf3-4440-a9ca-938a649e8c24 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.849111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb24e-b46b-4e07-bda2-8195ac13fb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.849344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb24e-b46b-4e07-bda2-8195ac13fb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.849659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbb24e-b46b-4e07-bda2-8195ac13fb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.850305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb24e-b46b-4e07-bda2-8195ac13fb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.851902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbb24e-b46b-4e07-bda2-8195ac13fb6a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.865658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 808/1607] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:05.866955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb24e-b46b-4e07-bda2-8195ac13fb6a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.879042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 800/1608] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:05.879042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76361-8cf3-4440-a9ca-938a649e8c24 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:05.879376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbb24e-b46b-4e07-bda2-8195ac13fb6a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.885171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498d86-10fb-4bbd-b695-53debb58cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.885891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498d86-10fb-4bbd-b695-53debb58cd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.886337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498d86-10fb-4bbd-b695-53debb58cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.886707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498d86-10fb-4bbd-b695-53debb58cd66 admin admin] PATH_INFO: `/v3/projects/f9ae28225d0b409f94b4c64c1f507e34/users/6abd568fb1504e14842fe0dab4fe0836/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.889125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76361-8cf3-4440-a9ca-938a649e8c24 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:05.890314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:05.895157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e4d95-e375-4332-a048-96d42ff18a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:05.895756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4d95-e375-4332-a048-96d42ff18a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.896033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4d95-e375-4332-a048-96d42ff18a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.896307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4d95-e375-4332-a048-96d42ff18a46 admin admin] PATH_INFO: `/v3/projects/3ee4310348eb43768284027e15e5d396/users/c29ecb6ed0f5439482957c4365aea4fc/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.905770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498d86-10fb-4bbd-b695-53debb58cd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ae28225d0b409f94b4c64c1f507e34, user_id=6abd568fb1504e14842fe0dab4fe0836, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.908450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498d86-10fb-4bbd-b695-53debb58cd66 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.913802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e4d95-e375-4332-a048-96d42ff18a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee4310348eb43768284027e15e5d396, user_id=c29ecb6ed0f5439482957c4365aea4fc, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:05.917029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e4d95-e375-4332-a048-96d42ff18a46 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:05.930288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 809/1609] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:05 2022] PUT /identity/v3/projects/f9ae28225d0b409f94b4c64c1f507e34/users/6abd568fb1504e14842fe0dab4fe0836/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:05.932146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd249e7c-e0de-4c89-ae8c-c21d2e2859a9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.932546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd249e7c-e0de-4c89-ae8c-c21d2e2859a9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.933007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd249e7c-e0de-4c89-ae8c-c21d2e2859a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.937875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 801/1610] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:05 2022] PUT /identity/v3/projects/3ee4310348eb43768284027e15e5d396/users/c29ecb6ed0f5439482957c4365aea4fc/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:05.939178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227fbfa-d192-416d-997d-3848a37bf67d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:05.939461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227fbfa-d192-416d-997d-3848a37bf67d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:05.939733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227fbfa-d192-416d-997d-3848a37bf67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:05.959011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-dd249e7c-e0de-4c89-ae8c-c21d2e2859a9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:05.960509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-dd249e7c-e0de-4c89-ae8c-c21d2e2859a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:05.961906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0227fbfa-d192-416d-997d-3848a37bf67d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:05.963596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0227fbfa-d192-416d-997d-3848a37bf67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:06.014700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:06.031047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 810/1611] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:06.031986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 802/1612] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:06.032348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd249e7c-e0de-4c89-ae8c-c21d2e2859a9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.037583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227fbfa-d192-416d-997d-3848a37bf67d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.043679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd249e7c-e0de-4c89-ae8c-c21d2e2859a9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.049940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227fbfa-d192-416d-997d-3848a37bf67d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.051755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8534e8-e908-4116-b1a0-1da09a8c76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.052437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8534e8-e908-4116-b1a0-1da09a8c76a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.052716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8534e8-e908-4116-b1a0-1da09a8c76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.052989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8534e8-e908-4116-b1a0-1da09a8c76a1 admin admin] PATH_INFO: `/v3/projects/9f9a6b60ca2a416181906189f13b49a8/users/1f8084bdf774417080410db0a7979273/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.055460 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8534e8-e908-4116-b1a0-1da09a8c76a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9a6b60ca2a416181906189f13b49a8, user_id=1f8084bdf774417080410db0a7979273, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.056384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14948f-6d8c-4aad-9f39-7f42c67c6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.057271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14948f-6d8c-4aad-9f39-7f42c67c6220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.059629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14948f-6d8c-4aad-9f39-7f42c67c6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.059629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14948f-6d8c-4aad-9f39-7f42c67c6220 admin admin] PATH_INFO: `/v3/projects/9b6085d469c748039a90bb21e8e94863/users/1d98cbfc834a47b6ad7e1fa49357c778/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.059866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8534e8-e908-4116-b1a0-1da09a8c76a1 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.072287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 811/1613] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:06 2022] PUT /identity/v3/projects/9f9a6b60ca2a416181906189f13b49a8/users/1f8084bdf774417080410db0a7979273/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:06.073619 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8534e8-e908-4116-b1a0-1da09a8c76a1 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.078311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14948f-6d8c-4aad-9f39-7f42c67c6220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6085d469c748039a90bb21e8e94863, user_id=1d98cbfc834a47b6ad7e1fa49357c778, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.079665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14948f-6d8c-4aad-9f39-7f42c67c6220 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.095626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 803/1614] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:06 2022] PUT /identity/v3/projects/9b6085d469c748039a90bb21e8e94863/users/1d98cbfc834a47b6ad7e1fa49357c778/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:06.096459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14948f-6d8c-4aad-9f39-7f42c67c6220 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.146357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8534e8-e908-4116-b1a0-1da09a8c76a1 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.160852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14948f-6d8c-4aad-9f39-7f42c67c6220 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.165593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d272f-acf7-47e8-8466-7791c2c41098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.166126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d272f-acf7-47e8-8466-7791c2c41098 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.166458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d272f-acf7-47e8-8466-7791c2c41098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.166738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d272f-acf7-47e8-8466-7791c2c41098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.167378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d272f-acf7-47e8-8466-7791c2c41098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.168964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d272f-acf7-47e8-8466-7791c2c41098 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.179406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 804/1615] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:06.180849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81eb44-b3f2-44f8-8842-c787c5313d73 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.181261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81eb44-b3f2-44f8-8842-c787c5313d73 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.181707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81eb44-b3f2-44f8-8842-c787c5313d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.201145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2d81eb44-b3f2-44f8-8842-c787c5313d73 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:06.202492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2d81eb44-b3f2-44f8-8842-c787c5313d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:06.206337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5287c-3fdb-427c-8146-9a8540d6e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.207019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5287c-3fdb-427c-8146-9a8540d6e9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.207303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5287c-3fdb-427c-8146-9a8540d6e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.207621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5287c-3fdb-427c-8146-9a8540d6e9cd admin admin] PATH_INFO: `/v3/projects/c3b5e2bb0f5a4522adad5ff2351f9c34/users/d223d046a7bf470ca1fe326720897879/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.214904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 805/1616] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:06.216388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ecb6-26dc-40ea-a6ae-cbdeca391607 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.216757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ecb6-26dc-40ea-a6ae-cbdeca391607 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.217096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60ecb6-26dc-40ea-a6ae-cbdeca391607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.224834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5287c-3fdb-427c-8146-9a8540d6e9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b5e2bb0f5a4522adad5ff2351f9c34, user_id=d223d046a7bf470ca1fe326720897879, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.227589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5287c-3fdb-427c-8146-9a8540d6e9cd admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.242189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 812/1617] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:06 2022] PUT /identity/v3/projects/c3b5e2bb0f5a4522adad5ff2351f9c34/users/d223d046a7bf470ca1fe326720897879/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:06.242974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5287c-3fdb-427c-8146-9a8540d6e9cd admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.246746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2a60ecb6-26dc-40ea-a6ae-cbdeca391607 None None] MFA Rules not processed for user `6abd568fb1504e14842fe0dab4fe0836`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:06.247963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a60ecb6-26dc-40ea-a6ae-cbdeca391607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:06.248154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:06.302143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5287c-3fdb-427c-8146-9a8540d6e9cd admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.305934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead9eb5-6f12-44f8-8cc8-3322bdda7ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.306670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead9eb5-6f12-44f8-8cc8-3322bdda7ccf service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.307077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead9eb5-6f12-44f8-8cc8-3322bdda7ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.307414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead9eb5-6f12-44f8-8cc8-3322bdda7ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.317405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 806/1618] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:06.318502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60ecb6-26dc-40ea-a6ae-cbdeca391607 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.319975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a60ecb6-26dc-40ea-a6ae-cbdeca391607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:06.331893 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60ecb6-26dc-40ea-a6ae-cbdeca391607 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.337164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80bd7-7db4-45c9-9517-d7799c9c7452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.338411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80bd7-7db4-45c9-9517-d7799c9c7452 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.338700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80bd7-7db4-45c9-9517-d7799c9c7452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.338974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80bd7-7db4-45c9-9517-d7799c9c7452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.370274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead9eb5-6f12-44f8-8cc8-3322bdda7ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.371776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead9eb5-6f12-44f8-8cc8-3322bdda7ccf service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.382244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 813/1619] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:06.383535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70a15-e48f-4ff8-86a0-8a33bf6e80f3 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.384086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70a15-e48f-4ff8-86a0-8a33bf6e80f3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.384357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f70a15-e48f-4ff8-86a0-8a33bf6e80f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.390749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:06.409009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80bd7-7db4-45c9-9517-d7799c9c7452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.410356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80bd7-7db4-45c9-9517-d7799c9c7452 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.414526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-60f70a15-e48f-4ff8-86a0-8a33bf6e80f3 None None] MFA Rules not processed for user `1f8084bdf774417080410db0a7979273`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:06.416590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-60f70a15-e48f-4ff8-86a0-8a33bf6e80f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:06.422492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 807/1620] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:06.423658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c126-136a-4efa-aa3f-d6191a128adf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.424008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c126-136a-4efa-aa3f-d6191a128adf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.424352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c126-136a-4efa-aa3f-d6191a128adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.445657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d5d1c126-136a-4efa-aa3f-d6191a128adf None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:06.446967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d5d1c126-136a-4efa-aa3f-d6191a128adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:06.457401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 808/1621] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:06.458965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1c126-136a-4efa-aa3f-d6191a128adf None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.472027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1c126-136a-4efa-aa3f-d6191a128adf None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.479104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5757501-fb3b-4158-90e7-6de4b7706f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.479670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5757501-fb3b-4158-90e7-6de4b7706f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.480063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5757501-fb3b-4158-90e7-6de4b7706f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.480546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5757501-fb3b-4158-90e7-6de4b7706f78 admin admin] PATH_INFO: `/v3/projects/f0423316eb4a4a3fb1c7eb41ac780f60/users/661f4cb01a13484c8a8d90c22e13bb26/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.501247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 814/1622] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:06.502695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f70a15-e48f-4ff8-86a0-8a33bf6e80f3 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.504286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5757501-fb3b-4158-90e7-6de4b7706f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0423316eb4a4a3fb1c7eb41ac780f60, user_id=661f4cb01a13484c8a8d90c22e13bb26, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.515594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5757501-fb3b-4158-90e7-6de4b7706f78 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.518761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f70a15-e48f-4ff8-86a0-8a33bf6e80f3 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.523200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801e740-a508-46ce-8dec-8e226ba01cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.524040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e740-a508-46ce-8dec-8e226ba01cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.524040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e740-a508-46ce-8dec-8e226ba01cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.524342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801e740-a508-46ce-8dec-8e226ba01cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.534839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 809/1623] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:06 2022] PUT /identity/v3/projects/f0423316eb4a4a3fb1c7eb41ac780f60/users/661f4cb01a13484c8a8d90c22e13bb26/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:06.536359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e740-a508-46ce-8dec-8e226ba01cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.537184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb912a-7325-4ae5-993b-3c24db5f03cc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.537669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb912a-7325-4ae5-993b-3c24db5f03cc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.537852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb912a-7325-4ae5-993b-3c24db5f03cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.537970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801e740-a508-46ce-8dec-8e226ba01cf8 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.557771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 815/1624] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:06.560477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801e740-a508-46ce-8dec-8e226ba01cf8 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.574152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9efb912a-7325-4ae5-993b-3c24db5f03cc None None] MFA Rules not processed for user `d223d046a7bf470ca1fe326720897879`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:06.575199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801e740-a508-46ce-8dec-8e226ba01cf8 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.575503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9efb912a-7325-4ae5-993b-3c24db5f03cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:06.604633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:06.657550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31ac4-4933-40b9-8765-42ad0d34a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.658514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31ac4-4933-40b9-8765-42ad0d34a779 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.658643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31ac4-4933-40b9-8765-42ad0d34a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.659071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31ac4-4933-40b9-8765-42ad0d34a779 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.659681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad31ac4-4933-40b9-8765-42ad0d34a779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.662135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad31ac4-4933-40b9-8765-42ad0d34a779 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.674721 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 810/1625] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:06.674721 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb912a-7325-4ae5-993b-3c24db5f03cc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.724136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 816/1626] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:06 2022] POST /identity/v3/projects => generated 403 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:06.725182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31ac4-4933-40b9-8765-42ad0d34a779 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.762305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb912a-7325-4ae5-993b-3c24db5f03cc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.798556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31ac4-4933-40b9-8765-42ad0d34a779 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.802971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0595-1533-41c4-b29b-cef40c6528b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.803417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0595-1533-41c4-b29b-cef40c6528b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.803797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0595-1533-41c4-b29b-cef40c6528b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.804137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0595-1533-41c4-b29b-cef40c6528b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.843232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d704867-92a4-48e9-81ba-9401288251ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.845397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704867-92a4-48e9-81ba-9401288251ae service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.845801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704867-92a4-48e9-81ba-9401288251ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.846482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d704867-92a4-48e9-81ba-9401288251ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.865976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:06.920954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0595-1533-41c4-b29b-cef40c6528b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.924836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0595-1533-41c4-b29b-cef40c6528b0 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.951756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 817/1627] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:06.954482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0595-1533-41c4-b29b-cef40c6528b0 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:06.971230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0595-1533-41c4-b29b-cef40c6528b0 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:06.981782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d704867-92a4-48e9-81ba-9401288251ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.984777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207bfa8-2e9e-4ebf-8d3b-0c4512cc184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:06.985062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d704867-92a4-48e9-81ba-9401288251ae service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:06.985719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bfa8-2e9e-4ebf-8d3b-0c4512cc184b admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:06.986461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bfa8-2e9e-4ebf-8d3b-0c4512cc184b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:06.986847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207bfa8-2e9e-4ebf-8d3b-0c4512cc184b admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:06.987608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207bfa8-2e9e-4ebf-8d3b-0c4512cc184b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:06.989847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207bfa8-2e9e-4ebf-8d3b-0c4512cc184b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.014837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 811/1628] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:07.014837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d704867-92a4-48e9-81ba-9401288251ae service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.015057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 818/1629] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:07.015057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207bfa8-2e9e-4ebf-8d3b-0c4512cc184b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.041870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207bfa8-2e9e-4ebf-8d3b-0c4512cc184b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:07.046957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d704867-92a4-48e9-81ba-9401288251ae service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:07.057646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50bcc-d45e-4ca9-8865-700de01ce5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:07.059220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50bcc-d45e-4ca9-8865-700de01ce5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.059531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4ec28-fa0c-45e0-9c68-cedbcd31425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:07.060229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ec28-fa0c-45e0-9c68-cedbcd31425a admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.060349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50bcc-d45e-4ca9-8865-700de01ce5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.060688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ec28-fa0c-45e0-9c68-cedbcd31425a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.062451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4ec28-fa0c-45e0-9c68-cedbcd31425a admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.062554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4ec28-fa0c-45e0-9c68-cedbcd31425a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:07.062659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa50bcc-d45e-4ca9-8865-700de01ce5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.067132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4ec28-fa0c-45e0-9c68-cedbcd31425a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.108796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 819/1630] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:07 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:07.109664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4ec28-fa0c-45e0-9c68-cedbcd31425a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.138095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4ec28-fa0c-45e0-9c68-cedbcd31425a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:07.147969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426d8fe-2381-4743-a580-d46bf767a1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:07.148659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d8fe-2381-4743-a580-d46bf767a1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.148934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d8fe-2381-4743-a580-d46bf767a1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.149222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426d8fe-2381-4743-a580-d46bf767a1c3 admin admin] PATH_INFO: `/v3/projects/f0423316eb4a4a3fb1c7eb41ac780f60/users/661f4cb01a13484c8a8d90c22e13bb26/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.151599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426d8fe-2381-4743-a580-d46bf767a1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0423316eb4a4a3fb1c7eb41ac780f60, user_id=661f4cb01a13484c8a8d90c22e13bb26, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:07.155845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426d8fe-2381-4743-a580-d46bf767a1c3 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.171178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 820/1631] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:07 2022] PUT /identity/v3/projects/f0423316eb4a4a3fb1c7eb41ac780f60/users/661f4cb01a13484c8a8d90c22e13bb26/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:07.172124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426d8fe-2381-4743-a580-d46bf767a1c3 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.192603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa50bcc-d45e-4ca9-8865-700de01ce5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:07.194563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:07.195840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa50bcc-d45e-4ca9-8865-700de01ce5d3 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.209375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 812/1632] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:07.211326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50bcc-d45e-4ca9-8865-700de01ce5d3 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.227245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa50bcc-d45e-4ca9-8865-700de01ce5d3 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:07.248227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426d8fe-2381-4743-a580-d46bf767a1c3 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:07.255602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356d9a1-b054-42e6-87ee-41f502ffc794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:07.257330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356d9a1-b054-42e6-87ee-41f502ffc794 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.257650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356d9a1-b054-42e6-87ee-41f502ffc794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.257979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356d9a1-b054-42e6-87ee-41f502ffc794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.258993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356d9a1-b054-42e6-87ee-41f502ffc794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:07.261228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356d9a1-b054-42e6-87ee-41f502ffc794 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.276658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 821/1633] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:07.278348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48fb6-10d6-415a-beb0-45588d611abc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.278677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48fb6-10d6-415a-beb0-45588d611abc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.278794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48fb6-10d6-415a-beb0-45588d611abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.314972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ddb48fb6-10d6-415a-beb0-45588d611abc None None] MFA Rules not processed for user `661f4cb01a13484c8a8d90c22e13bb26`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:07.316022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ddb48fb6-10d6-415a-beb0-45588d611abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:07.317546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34706d98-3dd8-421d-924b-c96b07120144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:07.318213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706d98-3dd8-421d-924b-c96b07120144 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.318665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706d98-3dd8-421d-924b-c96b07120144 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.318945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34706d98-3dd8-421d-924b-c96b07120144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.400768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 822/1634] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:07.401543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb48fb6-10d6-415a-beb0-45588d611abc None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.409120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34706d98-3dd8-421d-924b-c96b07120144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:07.411937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34706d98-3dd8-421d-924b-c96b07120144 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.412306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb48fb6-10d6-415a-beb0-45588d611abc None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:07.418464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d96d-2875-45ab-9850-364f1b613487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:07.418918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:07.419144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d96d-2875-45ab-9850-364f1b613487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.419487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d96d-2875-45ab-9850-364f1b613487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.420361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d96d-2875-45ab-9850-364f1b613487 admin admin] PATH_INFO: `/v3/projects/f6a2e49e1e3a4dd9ba46eaa40284e0dd/users/f73096cf90b442f6a3b52b5b00b8d4ff/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.428110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 813/1635] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:07.439970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1d96d-2875-45ab-9850-364f1b613487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a2e49e1e3a4dd9ba46eaa40284e0dd, user_id=f73096cf90b442f6a3b52b5b00b8d4ff, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:07.442694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1d96d-2875-45ab-9850-364f1b613487 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.460716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 823/1636] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:07 2022] PUT /identity/v3/projects/f6a2e49e1e3a4dd9ba46eaa40284e0dd/users/f73096cf90b442f6a3b52b5b00b8d4ff/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:07.465502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34706d98-3dd8-421d-924b-c96b07120144 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.492296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34706d98-3dd8-421d-924b-c96b07120144 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:07.656925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a28b4-6ee4-4a8c-8341-edd686f72711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:07.661099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a28b4-6ee4-4a8c-8341-edd686f72711 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.661802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a28b4-6ee4-4a8c-8341-edd686f72711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.662197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a28b4-6ee4-4a8c-8341-edd686f72711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.663586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a28b4-6ee4-4a8c-8341-edd686f72711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:07.669374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a28b4-6ee4-4a8c-8341-edd686f72711 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.693029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 814/1637] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:07.694710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d96d-2875-45ab-9850-364f1b613487 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.709061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d96d-2875-45ab-9850-364f1b613487 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:07.724825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be30f-af5c-490f-b225-f40f580d529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:07.727241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be30f-af5c-490f-b225-f40f580d529d admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.728069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be30f-af5c-490f-b225-f40f580d529d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.729042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34be30f-af5c-490f-b225-f40f580d529d admin admin] PATH_INFO: `/v3/projects/f6a2e49e1e3a4dd9ba46eaa40284e0dd/users/f73096cf90b442f6a3b52b5b00b8d4ff/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.733698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be30f-af5c-490f-b225-f40f580d529d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a2e49e1e3a4dd9ba46eaa40284e0dd, user_id=f73096cf90b442f6a3b52b5b00b8d4ff, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:07.742327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34be30f-af5c-490f-b225-f40f580d529d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:07.785351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 824/1638] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:07 2022] PUT /identity/v3/projects/f6a2e49e1e3a4dd9ba46eaa40284e0dd/users/f73096cf90b442f6a3b52b5b00b8d4ff/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:07.788090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b2ba-eea9-4b1b-b61a-c90d21370b95 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:07.788387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b2ba-eea9-4b1b-b61a-c90d21370b95 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:07.788668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b2ba-eea9-4b1b-b61a-c90d21370b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:07.846011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fe77b2ba-eea9-4b1b-b61a-c90d21370b95 None None] MFA Rules not processed for user `f73096cf90b442f6a3b52b5b00b8d4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:07.847959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fe77b2ba-eea9-4b1b-b61a-c90d21370b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:07.878302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be30f-af5c-490f-b225-f40f580d529d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:07.993891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34be30f-af5c-490f-b225-f40f580d529d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:08.004815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b83b8-61e6-41ef-bc4d-98350624f3fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:08.005577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b83b8-61e6-41ef-bc4d-98350624f3fa service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:08.006005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b83b8-61e6-41ef-bc4d-98350624f3fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:08.007392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b83b8-61e6-41ef-bc4d-98350624f3fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:08.019761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 815/1639] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:08.032312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:08.111006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b83b8-61e6-41ef-bc4d-98350624f3fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:08.113359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b83b8-61e6-41ef-bc4d-98350624f3fa service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:08.138972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 825/1640] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:08.289542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b2ba-eea9-4b1b-b61a-c90d21370b95 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:08.302185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b2ba-eea9-4b1b-b61a-c90d21370b95 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:08.309002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fddbe8-53c6-43bf-978c-3a55a8731a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:08.310005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fddbe8-53c6-43bf-978c-3a55a8731a10 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:08.310640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fddbe8-53c6-43bf-978c-3a55a8731a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:08.311067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fddbe8-53c6-43bf-978c-3a55a8731a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:08.327004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fddbe8-53c6-43bf-978c-3a55a8731a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:08.328752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fddbe8-53c6-43bf-978c-3a55a8731a10 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:08.353847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 816/1641] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:08 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:09.696813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b83b8-61e6-41ef-bc4d-98350624f3fa service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:09.880670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b83b8-61e6-41ef-bc4d-98350624f3fa service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:09.895324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:09.896365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:09.896933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:09.897611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] PATH_INFO: `/v3/users/6abd568fb1504e14842fe0dab4fe0836` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:09.961300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6abd568fb1504e14842fe0dab4fe0836)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:09.961300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:10.113572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6abd568fb1504e14842fe0dab4fe0836'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.133386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6abd568fb1504e14842fe0dab4fe0836'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.134430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6abd568fb1504e14842fe0dab4fe0836'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.135089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6abd568fb1504e14842fe0dab4fe0836'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.150169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6abd568fb1504e14842fe0dab4fe0836'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.189732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 826/1642] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:09 2022] DELETE /identity/v3/users/6abd568fb1504e14842fe0dab4fe0836 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:10.192563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a151-8207-4782-939b-dc5681a3f8af None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:10.193134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a151-8207-4782-939b-dc5681a3f8af None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:10.193452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a151-8207-4782-939b-dc5681a3f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:10.222331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2f89a151-8207-4782-939b-dc5681a3f8af None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:10.225239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2f89a151-8207-4782-939b-dc5681a3f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:10.343427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 817/1643] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:10.350563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:10.352993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:10.436190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:10.487186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fa09-3e2a-4d51-aaba-1baf13a3dc77 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:10.499042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587840c-0b18-4a8d-8ea7-60d7e24e1c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:10.499734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587840c-0b18-4a8d-8ea7-60d7e24e1c61 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:10.500199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587840c-0b18-4a8d-8ea7-60d7e24e1c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:10.500516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587840c-0b18-4a8d-8ea7-60d7e24e1c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:10.515061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587840c-0b18-4a8d-8ea7-60d7e24e1c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:10.516468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587840c-0b18-4a8d-8ea7-60d7e24e1c61 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:10.561079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 827/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:10.671666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89a151-8207-4782-939b-dc5681a3f8af None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:10.673340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2f89a151-8207-4782-939b-dc5681a3f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:10.717272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89a151-8207-4782-939b-dc5681a3f8af None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:10.727413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:10.728749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:10.730728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:10.730962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] PATH_INFO: `/v3/users/3e8d771d7cda42ffae0a2beb5fb51727` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:10.734013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8d771d7cda42ffae0a2beb5fb51727)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:10.737041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: WARNING py.warnings [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:39:10.737041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: warnings.warn(msg) Oct 03 12:39:10.737041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: Oct 03 12:39:10.738904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:10.742345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:10.874720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8d771d7cda42ffae0a2beb5fb51727'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.875935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8d771d7cda42ffae0a2beb5fb51727'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.909165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8d771d7cda42ffae0a2beb5fb51727'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.911479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8d771d7cda42ffae0a2beb5fb51727'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.936188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8d771d7cda42ffae0a2beb5fb51727'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:10.999900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdb1a-d220-447a-b003-1015589ae038 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:11.000352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdb1a-d220-447a-b003-1015589ae038 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:11.000510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdb1a-d220-447a-b003-1015589ae038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:11.000694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 818/1645] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:10 2022] DELETE /identity/v3/users/3e8d771d7cda42ffae0a2beb5fb51727 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:11.035895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-918fdb1a-d220-447a-b003-1015589ae038 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:11.037156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-918fdb1a-d220-447a-b003-1015589ae038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:11.198579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 828/1646] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:11.256493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:11.259194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:11.447804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d254ab9-3cbb-4114-a358-c9b22fb35949 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:11.457254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76801e9-5988-43dc-9a9d-91573bf0bed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:11.458233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76801e9-5988-43dc-9a9d-91573bf0bed5 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:11.459651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76801e9-5988-43dc-9a9d-91573bf0bed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:11.460089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76801e9-5988-43dc-9a9d-91573bf0bed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:11.474149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76801e9-5988-43dc-9a9d-91573bf0bed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:11.478897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76801e9-5988-43dc-9a9d-91573bf0bed5 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:11.503234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 819/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:12.460322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227ae4-0059-4f95-a904-336531690a15 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:12.460761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227ae4-0059-4f95-a904-336531690a15 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:12.461208 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227ae4-0059-4f95-a904-336531690a15 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:12.464311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 829/1648] 10.222.0.17 () {54 vars in 961 bytes} [Mon Oct 3 12:39:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:39:12.491389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f4a4-7c45-4811-bba7-dd148b6e2c32 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:12.491880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f4a4-7c45-4811-bba7-dd148b6e2c32 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:12.491969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f4a4-7c45-4811-bba7-dd148b6e2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:12.621498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7f43f4a4-7c45-4811-bba7-dd148b6e2c32 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:12.623479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7f43f4a4-7c45-4811-bba7-dd148b6e2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:12.808100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 820/1649] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Oct 3 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:12.816547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b6d9a-d1a4-4b67-8f7f-ccffbdee07bb None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:12.817180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b6d9a-d1a4-4b67-8f7f-ccffbdee07bb None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:12.817684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b6d9a-d1a4-4b67-8f7f-ccffbdee07bb None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:12.824364 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 830/1650] 10.222.0.17 () {54 vars in 912 bytes} [Mon Oct 3 12:39:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:39:12.837943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d95b86-d25a-41a3-a729-a97b7407d9a1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:12.837943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d95b86-d25a-41a3-a729-a97b7407d9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:12.837943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d95b86-d25a-41a3-a729-a97b7407d9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:12.850849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:12.879964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f3d95b86-d25a-41a3-a729-a97b7407d9a1 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:12.884976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f3d95b86-d25a-41a3-a729-a97b7407d9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:12.914681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 821/1651] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:12.945642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b6d9a-d1a4-4b67-8f7f-ccffbdee07bb None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:12.951377 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6f3b6d9a-d1a4-4b67-8f7f-ccffbdee07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:12.986803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d95b86-d25a-41a3-a729-a97b7407d9a1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:12.988795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f3d95b86-d25a-41a3-a729-a97b7407d9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:13.034938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d95b86-d25a-41a3-a729-a97b7407d9a1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:13.052312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:13.053004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:13.053280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:13.053622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] PATH_INFO: `/v3/projects/f9ae28225d0b409f94b4c64c1f507e34` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:13.055641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ae28225d0b409f94b4c64c1f507e34)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:13.068084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:13.262712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ae28225d0b409f94b4c64c1f507e34', 'request_id': 'req-9831675a-432f-418c-adbe-4ff113d34f15'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:13.277399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ae28225d0b409f94b4c64c1f507e34', 'request_id': 'req-9831675a-432f-418c-adbe-4ff113d34f15'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:13.304117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ae28225d0b409f94b4c64c1f507e34', 'request_id': 'req-9831675a-432f-418c-adbe-4ff113d34f15'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:13.362774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] The token cache is being invalidate because project f9ae28225d0b409f94b4c64c1f507e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:13.363187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:13.365621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:13.373087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 822/1652] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:12 2022] DELETE /identity/v3/projects/f9ae28225d0b409f94b4c64c1f507e34 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:39:13.373959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b6d9a-d1a4-4b67-8f7f-ccffbdee07bb None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:13.377022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:13.379029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:13.632412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:13.634062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:13.640928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:13.641764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:13.647688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:13.708955 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831675a-432f-418c-adbe-4ff113d34f15 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:13.735037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:13.735728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:13.738217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:13.738948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] PATH_INFO: `/v3/users/f73096cf90b442f6a3b52b5b00b8d4ff` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:13.744439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73096cf90b442f6a3b52b5b00b8d4ff)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:13.750020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:13.832416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:13.925401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:13.927228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:13.948925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 831/1653] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 1005 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:13.973922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73096cf90b442f6a3b52b5b00b8d4ff'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:13.982103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73096cf90b442f6a3b52b5b00b8d4ff'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:14.038942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73096cf90b442f6a3b52b5b00b8d4ff'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:14.043972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73096cf90b442f6a3b52b5b00b8d4ff'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:14.070607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73096cf90b442f6a3b52b5b00b8d4ff'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:14.115404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:14.135245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 823/1654] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:13 2022] DELETE /identity/v3/users/f73096cf90b442f6a3b52b5b00b8d4ff => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:15.181943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:15.184359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:15.214800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc500-a4c0-4ec1-86dc-90875fdc7229 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:15.443561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:15.444271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:15.444556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:15.444837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] PATH_INFO: `/v3/projects/2dea551121ae4414bf931a3d2e822c0f` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:15.454576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dea551121ae4414bf931a3d2e822c0f)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:15.462060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: WARNING py.warnings [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 03 12:39:15.462060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: warnings.warn(msg) Oct 03 12:39:15.462060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: Oct 03 12:39:15.464752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:15.786343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dea551121ae4414bf931a3d2e822c0f', 'request_id': 'req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:15.802039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dea551121ae4414bf931a3d2e822c0f', 'request_id': 'req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:15.849712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dea551121ae4414bf931a3d2e822c0f', 'request_id': 'req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:15.869463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] The token cache is being invalidate because project 2dea551121ae4414bf931a3d2e822c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:15.869905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:15.870577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a1a890ec-2a81-4abb-99c1-cc4bdc7e0b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:15.875022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 832/1655] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:15 2022] DELETE /identity/v3/projects/2dea551121ae4414bf931a3d2e822c0f => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:15.876536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:15.878067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:15.911728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fbb43-fbca-464a-bde4-f1160246e8b2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:16.050252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:16.051123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:16.051244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:16.052032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] PATH_INFO: `/v3/users/661f4cb01a13484c8a8d90c22e13bb26` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:16.054316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=661f4cb01a13484c8a8d90c22e13bb26)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:16.060590 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:16.171429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661f4cb01a13484c8a8d90c22e13bb26'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:16.172304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661f4cb01a13484c8a8d90c22e13bb26'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:16.191888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661f4cb01a13484c8a8d90c22e13bb26'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:16.192810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661f4cb01a13484c8a8d90c22e13bb26'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:16.214390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-053d3fbd-7eaf-4d15-b597-b285d65e3b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661f4cb01a13484c8a8d90c22e13bb26'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:16.262245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 824/1656] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:15 2022] DELETE /identity/v3/users/661f4cb01a13484c8a8d90c22e13bb26 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:16.403469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df801-3daf-4cc5-88d6-00d9f713e532 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:16.404038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df801-3daf-4cc5-88d6-00d9f713e532 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:16.404038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44df801-3daf-4cc5-88d6-00d9f713e532 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:16.406161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 833/1657] 10.222.0.17 () {54 vars in 961 bytes} [Mon Oct 3 12:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:39:16.447762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af797190-6f17-4188-936d-7a0c6d2a9708 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:16.448291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af797190-6f17-4188-936d-7a0c6d2a9708 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:16.448578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af797190-6f17-4188-936d-7a0c6d2a9708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:16.519462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-af797190-6f17-4188-936d-7a0c6d2a9708 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:16.527677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-af797190-6f17-4188-936d-7a0c6d2a9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:16.706598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df801-3daf-4cc5-88d6-00d9f713e532 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:16.709752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c44df801-3daf-4cc5-88d6-00d9f713e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:16.807798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 825/1658] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Oct 3 12:39:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:16.815006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11faec9-8330-4d40-b7e4-bf470bb6e4f9 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:16.815006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11faec9-8330-4d40-b7e4-bf470bb6e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:16.815006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11faec9-8330-4d40-b7e4-bf470bb6e4f9 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:16.817293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 826/1659] 10.222.0.17 () {54 vars in 912 bytes} [Mon Oct 3 12:39:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:39:16.824325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cefa6-4ec3-4392-8b3a-d9394dfd3411 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:16.824765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cefa6-4ec3-4392-8b3a-d9394dfd3411 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:16.825870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cefa6-4ec3-4392-8b3a-d9394dfd3411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:16.877042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-063cefa6-4ec3-4392-8b3a-d9394dfd3411 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:16.881571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-063cefa6-4ec3-4392-8b3a-d9394dfd3411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:16.933638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 827/1660] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:39:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:16.945696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cefa6-4ec3-4392-8b3a-d9394dfd3411 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:16.948096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44df801-3daf-4cc5-88d6-00d9f713e532 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:16.949253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-063cefa6-4ec3-4392-8b3a-d9394dfd3411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:16.957612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:16.971529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:16.978128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:16.978576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:16.978972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] PATH_INFO: `/v3/projects/f6a2e49e1e3a4dd9ba46eaa40284e0dd` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:16.983574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a2e49e1e3a4dd9ba46eaa40284e0dd)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:16.989220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:17.005793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:17.130542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a2e49e1e3a4dd9ba46eaa40284e0dd', 'request_id': 'req-b13ae370-229f-488e-817b-80d600c38eb2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.147878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a2e49e1e3a4dd9ba46eaa40284e0dd', 'request_id': 'req-b13ae370-229f-488e-817b-80d600c38eb2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.166726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a2e49e1e3a4dd9ba46eaa40284e0dd', 'request_id': 'req-b13ae370-229f-488e-817b-80d600c38eb2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.176581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cefa6-4ec3-4392-8b3a-d9394dfd3411 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:17.199945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] The token cache is being invalidate because project f6a2e49e1e3a4dd9ba46eaa40284e0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:17.200501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.202694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b13ae370-229f-488e-817b-80d600c38eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.207989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 834/1661] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:16 2022] DELETE /identity/v3/projects/f6a2e49e1e3a4dd9ba46eaa40284e0dd => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:17.214486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44969-7e9f-47bc-9a11-62d1c3489bca None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:17.215097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44969-7e9f-47bc-9a11-62d1c3489bca None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:17.215604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44969-7e9f-47bc-9a11-62d1c3489bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:17.281844 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8bb44969-7e9f-47bc-9a11-62d1c3489bca None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:17.284679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8bb44969-7e9f-47bc-9a11-62d1c3489bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:17.400397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c706b-d5bb-43fa-a9dc-116faf16c5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:17.402504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c706b-d5bb-43fa-a9dc-116faf16c5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:17.402996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c706b-d5bb-43fa-a9dc-116faf16c5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:17.403438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c706b-d5bb-43fa-a9dc-116faf16c5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:17.413423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-578c706b-d5bb-43fa-a9dc-116faf16c5b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:17.509948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 835/1662] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:17.520937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44969-7e9f-47bc-9a11-62d1c3489bca None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:17.526479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8bb44969-7e9f-47bc-9a11-62d1c3489bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:17.567399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44969-7e9f-47bc-9a11-62d1c3489bca None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:17.583717 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:17.584612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:17.585042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:17.585489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] PATH_INFO: `/v3/users/80e164ab4bd144579990dd67cb739666` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:17.586995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e164ab4bd144579990dd67cb739666)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:17.589219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:17.652704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c706b-d5bb-43fa-a9dc-116faf16c5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:17.658540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c706b-d5bb-43fa-a9dc-116faf16c5b2 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:17.704101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e164ab4bd144579990dd67cb739666'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.713783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 828/1663] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:39:17.723675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704f95-87a9-4105-a103-420652730897 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:17.727400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704f95-87a9-4105-a103-420652730897 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:17.727765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0704f95-87a9-4105-a103-420652730897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:17.731037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e164ab4bd144579990dd67cb739666'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.731983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e164ab4bd144579990dd67cb739666'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.732640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e164ab4bd144579990dd67cb739666'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.760245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ccdab6ab-42a6-46a8-9551-fcf5c026fe99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e164ab4bd144579990dd67cb739666'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:17.826362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b0704f95-87a9-4105-a103-420652730897 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:17.827465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 836/1664] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:17 2022] DELETE /identity/v3/users/80e164ab4bd144579990dd67cb739666 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:17.834061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06b35-68b1-48d0-95a4-495b420c0f54 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:17.834284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06b35-68b1-48d0-95a4-495b420c0f54 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:17.834375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b0704f95-87a9-4105-a103-420652730897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:17.834552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d06b35-68b1-48d0-95a4-495b420c0f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:17.860359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:17.889860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-c0d06b35-68b1-48d0-95a4-495b420c0f54 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:17.893961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c0d06b35-68b1-48d0-95a4-495b420c0f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:18.007657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:18.033048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 829/1665] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:18.033255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 837/1666] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:18.036438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0704f95-87a9-4105-a103-420652730897 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:18.054934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06b35-68b1-48d0-95a4-495b420c0f54 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:18.056741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c0d06b35-68b1-48d0-95a4-495b420c0f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:18.079586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0704f95-87a9-4105-a103-420652730897 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:18.100913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d01ff-ca0d-4cfb-9691-b187de646a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:18.101595 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d01ff-ca0d-4cfb-9691-b187de646a17 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:18.106863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d01ff-ca0d-4cfb-9691-b187de646a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:18.107199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d01ff-ca0d-4cfb-9691-b187de646a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:18.107933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d01ff-ca0d-4cfb-9691-b187de646a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:18.112503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d01ff-ca0d-4cfb-9691-b187de646a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:18.114281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d01ff-ca0d-4cfb-9691-b187de646a17 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:18.160183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 830/1667] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:18.164516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0bd9-6bc7-46d9-9388-ad2720c3214b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:18.165191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0bd9-6bc7-46d9-9388-ad2720c3214b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:18.172104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0bd9-6bc7-46d9-9388-ad2720c3214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:18.225901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d06b35-68b1-48d0-95a4-495b420c0f54 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:18.236720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e76df4-14d1-434f-b0d5-4d7f3e8fed1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:18.237467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76df4-14d1-434f-b0d5-4d7f3e8fed1b service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:18.240292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76df4-14d1-434f-b0d5-4d7f3e8fed1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:18.240709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e76df4-14d1-434f-b0d5-4d7f3e8fed1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:18.256718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f1ca0bd9-6bc7-46d9-9388-ad2720c3214b None None] MFA Rules not processed for user `c29ecb6ed0f5439482957c4365aea4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:18.260488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f1ca0bd9-6bc7-46d9-9388-ad2720c3214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:18.265438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e76df4-14d1-434f-b0d5-4d7f3e8fed1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:18.269097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e76df4-14d1-434f-b0d5-4d7f3e8fed1b service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:18.314612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 838/1668] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:39:18.325742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e76df4-14d1-434f-b0d5-4d7f3e8fed1b service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:18.366659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e76df4-14d1-434f-b0d5-4d7f3e8fed1b service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:18.394843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:18.395681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:18.396042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:18.396401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:18.397334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:18.403635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:18.474782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 831/1669] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:18.485900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca0bd9-6bc7-46d9-9388-ad2720c3214b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:18.494664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f1ca0bd9-6bc7-46d9-9388-ad2720c3214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:18.507512 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 839/1670] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:18 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:18.512353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:18.522031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:18.522944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca0bd9-6bc7-46d9-9388-ad2720c3214b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:18.671534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:18.672206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:18.672491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:18.673143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] PATH_INFO: `/v3/projects/f0423316eb4a4a3fb1c7eb41ac780f60` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:18.676394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0423316eb4a4a3fb1c7eb41ac780f60)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:18.678375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:18.724945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcce7b-4b3f-42f0-b42a-7848383dd7b4 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:18.738116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff677b-bc45-4876-8b52-889f36e8f134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:18.739685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff677b-bc45-4876-8b52-889f36e8f134 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:18.740090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff677b-bc45-4876-8b52-889f36e8f134 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:18.741823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff677b-bc45-4876-8b52-889f36e8f134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:18.797601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:18.798486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0423316eb4a4a3fb1c7eb41ac780f60', 'request_id': 'req-c4d7945f-9388-444d-bc67-ad56da43f05b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:18.813856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0423316eb4a4a3fb1c7eb41ac780f60', 'request_id': 'req-c4d7945f-9388-444d-bc67-ad56da43f05b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:18.823547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0423316eb4a4a3fb1c7eb41ac780f60', 'request_id': 'req-c4d7945f-9388-444d-bc67-ad56da43f05b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:18.850896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] The token cache is being invalidate because project f0423316eb4a4a3fb1c7eb41ac780f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:18.850896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:18.852773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:18.856133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 832/1671] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:18 2022] DELETE /identity/v3/projects/f0423316eb4a4a3fb1c7eb41ac780f60 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:39:18.857846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:18.866457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:18.881304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:18.882112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff677b-bc45-4876-8b52-889f36e8f134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:18.888334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff677b-bc45-4876-8b52-889f36e8f134 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:18.912624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 840/1672] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:18.915380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d239-751e-4d35-9db5-09b75985d49c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:18.915806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d239-751e-4d35-9db5-09b75985d49c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:18.917853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d239-751e-4d35-9db5-09b75985d49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:18.958740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a721d239-751e-4d35-9db5-09b75985d49c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:18.960152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a721d239-751e-4d35-9db5-09b75985d49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:19.019537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7945f-9388-444d-bc67-ad56da43f05b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.033872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e77b-8ffa-43df-a9d4-4be638d1e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.034514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e77b-8ffa-43df-a9d4-4be638d1e96e admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.034802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e77b-8ffa-43df-a9d4-4be638d1e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.035077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e77b-8ffa-43df-a9d4-4be638d1e96e admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.035731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9e77b-8ffa-43df-a9d4-4be638d1e96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.041811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9e77b-8ffa-43df-a9d4-4be638d1e96e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.085149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 833/1673] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:18 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:19.089751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e77b-8ffa-43df-a9d4-4be638d1e96e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.112036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e77b-8ffa-43df-a9d4-4be638d1e96e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.123431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 841/1674] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:19.131033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39386e1-4350-498d-a825-64b640b03fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.131914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39386e1-4350-498d-a825-64b640b03fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.132137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39386e1-4350-498d-a825-64b640b03fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.132519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39386e1-4350-498d-a825-64b640b03fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.132626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb1731-5838-4afe-8abc-21ed80f9e3e1 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.133034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb1731-5838-4afe-8abc-21ed80f9e3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.134933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb1731-5838-4afe-8abc-21ed80f9e3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.135060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39386e1-4350-498d-a825-64b640b03fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.137010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39386e1-4350-498d-a825-64b640b03fe6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.165453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 834/1675] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:39:19.169382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39386e1-4350-498d-a825-64b640b03fe6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.190382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39386e1-4350-498d-a825-64b640b03fe6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.192276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8dfb1731-5838-4afe-8abc-21ed80f9e3e1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:19.197846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8dfb1731-5838-4afe-8abc-21ed80f9e3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:19.206174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed25c-2096-49d5-8738-5218a19e411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.206822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed25c-2096-49d5-8738-5218a19e411c admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.207110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed25c-2096-49d5-8738-5218a19e411c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.207383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed25c-2096-49d5-8738-5218a19e411c admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.208085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaed25c-2096-49d5-8738-5218a19e411c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.217271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaed25c-2096-49d5-8738-5218a19e411c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.225163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 842/1676] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:19.228417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb1731-5838-4afe-8abc-21ed80f9e3e1 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.237260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 835/1677] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:19.239102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed25c-2096-49d5-8738-5218a19e411c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.249275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb1731-5838-4afe-8abc-21ed80f9e3e1 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.263755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.263902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed25c-2096-49d5-8738-5218a19e411c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.264705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.265099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.265593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.266557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:19.266970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.269539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.288547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f1c6a-7607-44e5-8bd0-9540a1223942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.289360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1c6a-7607-44e5-8bd0-9540a1223942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.289804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1c6a-7607-44e5-8bd0-9540a1223942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.290090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f1c6a-7607-44e5-8bd0-9540a1223942 admin admin] PATH_INFO: `/v3/projects/c307f5ba25cc4ba8873117f3ccc0195e/users/5a626fc25feb4d5ea675967224bf2ab8/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.316122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 843/1678] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:39:19.319177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.338523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f1c6a-7607-44e5-8bd0-9540a1223942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c307f5ba25cc4ba8873117f3ccc0195e, user_id=5a626fc25feb4d5ea675967224bf2ab8, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.345117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefaaf7-7772-4fba-b11d-2c6179884fdf admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.352209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f1c6a-7607-44e5-8bd0-9540a1223942 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.359483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043f0a5-4ac4-4606-bbcf-1d9e774db153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.360279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f0a5-4ac4-4606-bbcf-1d9e774db153 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.360670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f0a5-4ac4-4606-bbcf-1d9e774db153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.361054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043f0a5-4ac4-4606-bbcf-1d9e774db153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.361855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043f0a5-4ac4-4606-bbcf-1d9e774db153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.366276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043f0a5-4ac4-4606-bbcf-1d9e774db153 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.388181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 836/1679] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:19 2022] PUT /identity/v3/projects/c307f5ba25cc4ba8873117f3ccc0195e/users/5a626fc25feb4d5ea675967224bf2ab8/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:39:19.399589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2f5a6-031f-4f65-b571-bc0500ef17d9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.399917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2f5a6-031f-4f65-b571-bc0500ef17d9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.400199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2f5a6-031f-4f65-b571-bc0500ef17d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.454733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 844/1680] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:19 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:39:19.461719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043f0a5-4ac4-4606-bbcf-1d9e774db153 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.484178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f2d2f5a6-031f-4f65-b571-bc0500ef17d9 None None] MFA Rules not processed for user `5a626fc25feb4d5ea675967224bf2ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:19.486486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f2d2f5a6-031f-4f65-b571-bc0500ef17d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:19.659411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043f0a5-4ac4-4606-bbcf-1d9e774db153 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.679334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62dcf2-087a-4526-bd90-e3102c29cbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.680230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62dcf2-087a-4526-bd90-e3102c29cbff admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.680667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62dcf2-087a-4526-bd90-e3102c29cbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.680955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62dcf2-087a-4526-bd90-e3102c29cbff admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.682448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62dcf2-087a-4526-bd90-e3102c29cbff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.684675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62dcf2-087a-4526-bd90-e3102c29cbff admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.731856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 837/1681] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:19.738767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2f5a6-031f-4f65-b571-bc0500ef17d9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.740277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 845/1682] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:19 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:19.747971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62dcf2-087a-4526-bd90-e3102c29cbff admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.769963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2f5a6-031f-4f65-b571-bc0500ef17d9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.771512 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62dcf2-087a-4526-bd90-e3102c29cbff admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.777000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05361ec4-20f1-49b7-9781-d9e967992142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.777785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361ec4-20f1-49b7-9781-d9e967992142 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.778080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361ec4-20f1-49b7-9781-d9e967992142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.778357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361ec4-20f1-49b7-9781-d9e967992142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.779582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05361ec4-20f1-49b7-9781-d9e967992142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.785104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4d89-4b2a-4339-b74a-d0822fb0d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:19.785798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05361ec4-20f1-49b7-9781-d9e967992142 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.787049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4d89-4b2a-4339-b74a-d0822fb0d22a admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:19.787500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4d89-4b2a-4339-b74a-d0822fb0d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:19.788743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a4d89-4b2a-4339-b74a-d0822fb0d22a admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:19.789754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a4d89-4b2a-4339-b74a-d0822fb0d22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:19.794035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a4d89-4b2a-4339-b74a-d0822fb0d22a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:19.809639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:19.842458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 846/1683] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:19.845894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4d89-4b2a-4339-b74a-d0822fb0d22a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.849282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 838/1684] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:19 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:19.854090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05361ec4-20f1-49b7-9781-d9e967992142 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:19.886574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a4d89-4b2a-4339-b74a-d0822fb0d22a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:19.910679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:20.016634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05361ec4-20f1-49b7-9781-d9e967992142 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:20.032012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceadbd7-2621-4eed-ad3d-bafa9b359971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.032651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceadbd7-2621-4eed-ad3d-bafa9b359971 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.032954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceadbd7-2621-4eed-ad3d-bafa9b359971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.033210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceadbd7-2621-4eed-ad3d-bafa9b359971 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.034061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceadbd7-2621-4eed-ad3d-bafa9b359971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.036293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceadbd7-2621-4eed-ad3d-bafa9b359971 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:20.055374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b663-cbde-4f53-ab64-1767184de24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.056510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b663-cbde-4f53-ab64-1767184de24f admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.056780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b663-cbde-4f53-ab64-1767184de24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.057071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b663-cbde-4f53-ab64-1767184de24f admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.057784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92b663-cbde-4f53-ab64-1767184de24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.059636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92b663-cbde-4f53-ab64-1767184de24f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:20.079049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 847/1685] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:20.084792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b663-cbde-4f53-ab64-1767184de24f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:20.089066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 839/1686] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:19 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:20.093351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceadbd7-2621-4eed-ad3d-bafa9b359971 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:20.107455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92b663-cbde-4f53-ab64-1767184de24f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:20.113925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceadbd7-2621-4eed-ad3d-bafa9b359971 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:20.127361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45102cf7-cef3-47f9-9cf7-51f2ad2a9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.127639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688654a1-eef6-4a3b-95d9-3eed3d9d5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.128058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45102cf7-cef3-47f9-9cf7-51f2ad2a9101 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.128285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688654a1-eef6-4a3b-95d9-3eed3d9d5c7e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.128413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45102cf7-cef3-47f9-9cf7-51f2ad2a9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.128561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688654a1-eef6-4a3b-95d9-3eed3d9d5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.128655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45102cf7-cef3-47f9-9cf7-51f2ad2a9101 admin admin] PATH_INFO: `/v3/projects/931e1d94ac0d4f6395167f4e029997e2/users/856a7623116045d7b4e107cb3ab1d6ac/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.128841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688654a1-eef6-4a3b-95d9-3eed3d9d5c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.129640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688654a1-eef6-4a3b-95d9-3eed3d9d5c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.131349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688654a1-eef6-4a3b-95d9-3eed3d9d5c7e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:20.158197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 840/1687] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:39:20.158467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45102cf7-cef3-47f9-9cf7-51f2ad2a9101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=931e1d94ac0d4f6395167f4e029997e2, user_id=856a7623116045d7b4e107cb3ab1d6ac, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.161140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688654a1-eef6-4a3b-95d9-3eed3d9d5c7e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:20.164484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45102cf7-cef3-47f9-9cf7-51f2ad2a9101 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:20.187693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688654a1-eef6-4a3b-95d9-3eed3d9d5c7e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:20.191579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 848/1688] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:20 2022] PUT /identity/v3/projects/931e1d94ac0d4f6395167f4e029997e2/users/856a7623116045d7b4e107cb3ab1d6ac/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:39:20.202043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225466f-1343-4787-a0d1-94d719b8489b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.202330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225466f-1343-4787-a0d1-94d719b8489b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.202667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225466f-1343-4787-a0d1-94d719b8489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.259114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-9225466f-1343-4787-a0d1-94d719b8489b None None] MFA Rules not processed for user `856a7623116045d7b4e107cb3ab1d6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:20.260522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9225466f-1343-4787-a0d1-94d719b8489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:20.323831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f900105-57ee-401c-b059-35a0bab1cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.324694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900105-57ee-401c-b059-35a0bab1cd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.325091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900105-57ee-401c-b059-35a0bab1cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.325542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f900105-57ee-401c-b059-35a0bab1cd03 admin admin] PATH_INFO: `/v3/projects/26302f6cca5c46fe8b60a6cc6c0b6744/users/280d3bba64044848a091b3b73ade2c74/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.351144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f900105-57ee-401c-b059-35a0bab1cd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26302f6cca5c46fe8b60a6cc6c0b6744, user_id=280d3bba64044848a091b3b73ade2c74, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.356159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f900105-57ee-401c-b059-35a0bab1cd03 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:20.378488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 841/1689] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:20 2022] PUT /identity/v3/projects/26302f6cca5c46fe8b60a6cc6c0b6744/users/280d3bba64044848a091b3b73ade2c74/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:20.384684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f900105-57ee-401c-b059-35a0bab1cd03 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:20.418173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 849/1690] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:20.425918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225466f-1343-4787-a0d1-94d719b8489b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:20.456568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225466f-1343-4787-a0d1-94d719b8489b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:20.496945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f900105-57ee-401c-b059-35a0bab1cd03 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:20.557752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499027-8667-4ee0-af62-cad2a505d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.560681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499027-8667-4ee0-af62-cad2a505d019 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.565149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499027-8667-4ee0-af62-cad2a505d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.565448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5499027-8667-4ee0-af62-cad2a505d019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.566185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5499027-8667-4ee0-af62-cad2a505d019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.568164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5499027-8667-4ee0-af62-cad2a505d019 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:20.608218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 842/1691] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:20.611023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499027-8667-4ee0-af62-cad2a505d019 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:20.612421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739feaba-74aa-4aee-a8cd-a7f610557135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.613468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739feaba-74aa-4aee-a8cd-a7f610557135 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.614162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739feaba-74aa-4aee-a8cd-a7f610557135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.614981 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739feaba-74aa-4aee-a8cd-a7f610557135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.615855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739feaba-74aa-4aee-a8cd-a7f610557135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.619191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739feaba-74aa-4aee-a8cd-a7f610557135 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:20.636839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:20.640805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5499027-8667-4ee0-af62-cad2a505d019 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:20.668108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0da038-73e4-4c0c-a547-11c87d5a0ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.669267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da038-73e4-4c0c-a547-11c87d5a0ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.669873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da038-73e4-4c0c-a547-11c87d5a0ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.670363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0da038-73e4-4c0c-a547-11c87d5a0ca8 admin admin] PATH_INFO: `/v3/projects/26302f6cca5c46fe8b60a6cc6c0b6744/users/280d3bba64044848a091b3b73ade2c74/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.679439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0da038-73e4-4c0c-a547-11c87d5a0ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26302f6cca5c46fe8b60a6cc6c0b6744, user_id=280d3bba64044848a091b3b73ade2c74, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.684085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0da038-73e4-4c0c-a547-11c87d5a0ca8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:20.716328 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 850/1692] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:20 2022] POST /identity/v3/projects => generated 381 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:20.717866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739feaba-74aa-4aee-a8cd-a7f610557135 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:20.731281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 843/1693] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:20 2022] PUT /identity/v3/projects/26302f6cca5c46fe8b60a6cc6c0b6744/users/280d3bba64044848a091b3b73ade2c74/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:20.744029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c44f-a0c5-404f-8d6d-5796a35496cc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.744636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c44f-a0c5-404f-8d6d-5796a35496cc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.745841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61c44f-a0c5-404f-8d6d-5796a35496cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.768562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:20.844530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0d61c44f-a0c5-404f-8d6d-5796a35496cc None None] MFA Rules not processed for user `280d3bba64044848a091b3b73ade2c74`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:20.847670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0d61c44f-a0c5-404f-8d6d-5796a35496cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:20.956070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739feaba-74aa-4aee-a8cd-a7f610557135 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:20.978374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d0ba-52de-4228-a235-8934cbe91c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:20.979468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d0ba-52de-4228-a235-8934cbe91c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:20.979468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d0ba-52de-4228-a235-8934cbe91c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:20.980123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d0ba-52de-4228-a235-8934cbe91c16 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:20.981637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d0ba-52de-4228-a235-8934cbe91c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:20.984738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d0ba-52de-4228-a235-8934cbe91c16 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:21.052657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 851/1694] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:20 2022] POST /identity/v3/users => generated 297 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:21.059034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d0ba-52de-4228-a235-8934cbe91c16 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:21.086940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d0ba-52de-4228-a235-8934cbe91c16 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:21.094243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 844/1695] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:21.098815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639866fc-b02e-4a73-a4f9-49097c6591e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:21.099853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639866fc-b02e-4a73-a4f9-49097c6591e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:21.100297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639866fc-b02e-4a73-a4f9-49097c6591e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:21.101013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639866fc-b02e-4a73-a4f9-49097c6591e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:21.102065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639866fc-b02e-4a73-a4f9-49097c6591e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:21.104213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639866fc-b02e-4a73-a4f9-49097c6591e1 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:21.107185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61c44f-a0c5-404f-8d6d-5796a35496cc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:21.108842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0d61c44f-a0c5-404f-8d6d-5796a35496cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:21.138870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 852/1696] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:21.143151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639866fc-b02e-4a73-a4f9-49097c6591e1 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:21.176080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639866fc-b02e-4a73-a4f9-49097c6591e1 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:21.200515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa3a9-04e2-4294-b1ab-627f674e17ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:21.203623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa3a9-04e2-4294-b1ab-627f674e17ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:21.204216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa3a9-04e2-4294-b1ab-627f674e17ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:21.204647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa3a9-04e2-4294-b1ab-627f674e17ab admin admin] PATH_INFO: `/v3/projects/501045e2dcea4d559fefd0ad7297e846/users/4f39346504314469ac21cfde56ee2157/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:21.253433 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caa3a9-04e2-4294-b1ab-627f674e17ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=501045e2dcea4d559fefd0ad7297e846, user_id=4f39346504314469ac21cfde56ee2157, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:21.266190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caa3a9-04e2-4294-b1ab-627f674e17ab admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:21.310551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61c44f-a0c5-404f-8d6d-5796a35496cc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:21.319980 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 853/1697] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:21 2022] PUT /identity/v3/projects/501045e2dcea4d559fefd0ad7297e846/users/4f39346504314469ac21cfde56ee2157/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:21.327219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa3a9-04e2-4294-b1ab-627f674e17ab admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:21.465956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e2a08-c361-4ae5-ab91-1646247eb0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:21.467024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2a08-c361-4ae5-ab91-1646247eb0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:21.467540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2a08-c361-4ae5-ab91-1646247eb0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:21.469673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2a08-c361-4ae5-ab91-1646247eb0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:21.481208 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa3a9-04e2-4294-b1ab-627f674e17ab admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:21.494159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b03d-f9de-4ede-b9f9-4801576b136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:21.494795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b03d-f9de-4ede-b9f9-4801576b136b admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:21.495076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b03d-f9de-4ede-b9f9-4801576b136b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:21.495350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b03d-f9de-4ede-b9f9-4801576b136b admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:21.496003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b03d-f9de-4ede-b9f9-4801576b136b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:21.497655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b03d-f9de-4ede-b9f9-4801576b136b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:21.522665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 854/1698] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:21.528236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b03d-f9de-4ede-b9f9-4801576b136b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:21.577109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b03d-f9de-4ede-b9f9-4801576b136b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:21.600456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cce88-9305-4da2-8343-fbc48e7aa903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:21.605325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cce88-9305-4da2-8343-fbc48e7aa903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:21.605803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cce88-9305-4da2-8343-fbc48e7aa903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:21.610485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cce88-9305-4da2-8343-fbc48e7aa903 admin admin] PATH_INFO: `/v3/projects/501045e2dcea4d559fefd0ad7297e846/users/4f39346504314469ac21cfde56ee2157/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:21.616728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cce88-9305-4da2-8343-fbc48e7aa903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501045e2dcea4d559fefd0ad7297e846, user_id=4f39346504314469ac21cfde56ee2157, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:21.619746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cce88-9305-4da2-8343-fbc48e7aa903 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:21.642516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 855/1699] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:21 2022] PUT /identity/v3/projects/501045e2dcea4d559fefd0ad7297e846/users/4f39346504314469ac21cfde56ee2157/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:21.664626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b6aa8-719b-4186-90ac-799c6ad3b18a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:21.664919 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b6aa8-719b-4186-90ac-799c6ad3b18a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:21.665226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b6aa8-719b-4186-90ac-799c6ad3b18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:21.713904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:21.733554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e2a08-c361-4ae5-ab91-1646247eb0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:21.735049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e2a08-c361-4ae5-ab91-1646247eb0d5 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:21.781975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 845/1700] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:39:21.819772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e2a08-c361-4ae5-ab91-1646247eb0d5 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:21.820040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5f8b6aa8-719b-4186-90ac-799c6ad3b18a None None] MFA Rules not processed for user `4f39346504314469ac21cfde56ee2157`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:21.823007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5f8b6aa8-719b-4186-90ac-799c6ad3b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:21.838261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e2a08-c361-4ae5-ab91-1646247eb0d5 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:21.865210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:21.964827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:21.966232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:21.967724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:21.969502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] PATH_INFO: `/v3/users/5a626fc25feb4d5ea675967224bf2ab8` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:21.981211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a626fc25feb4d5ea675967224bf2ab8)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:21.988320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:22.070057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 856/1701] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:22.072162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b6aa8-719b-4186-90ac-799c6ad3b18a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:22.087944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5f8b6aa8-719b-4186-90ac-799c6ad3b18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:22.160971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b6aa8-719b-4186-90ac-799c6ad3b18a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:22.164772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a626fc25feb4d5ea675967224bf2ab8'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.166692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a626fc25feb4d5ea675967224bf2ab8'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.174674 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:22.175364 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:22.175877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:22.176148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] PATH_INFO: `/v3/projects/8505f5715a1140549d5537f9b2c2bee7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:22.179900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8505f5715a1140549d5537f9b2c2bee7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:22.186074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:22.188880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a626fc25feb4d5ea675967224bf2ab8'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.190292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a626fc25feb4d5ea675967224bf2ab8'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.209441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a626fc25feb4d5ea675967224bf2ab8'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.276692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 846/1702] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:21 2022] DELETE /identity/v3/users/5a626fc25feb4d5ea675967224bf2ab8 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:39:22.278818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:22.284249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:22.359281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8505f5715a1140549d5537f9b2c2bee7', 'request_id': 'req-eeed4f34-e57e-4126-a689-945ff27a04b5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.383062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8505f5715a1140549d5537f9b2c2bee7', 'request_id': 'req-eeed4f34-e57e-4126-a689-945ff27a04b5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.409694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8505f5715a1140549d5537f9b2c2bee7', 'request_id': 'req-eeed4f34-e57e-4126-a689-945ff27a04b5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.466424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] The token cache is being invalidate because project 8505f5715a1140549d5537f9b2c2bee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:22.466781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.470611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-eeed4f34-e57e-4126-a689-945ff27a04b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.473704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 857/1703] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:22 2022] DELETE /identity/v3/projects/8505f5715a1140549d5537f9b2c2bee7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:22.485231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250501-e902-41e0-8fa0-0bc21b298095 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:22.487825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250501-e902-41e0-8fa0-0bc21b298095 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:22.488133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68250501-e902-41e0-8fa0-0bc21b298095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:22.530676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd79e60-cc20-4b69-908f-824d061d0b1e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:22.544716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-68250501-e902-41e0-8fa0-0bc21b298095 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:22.547199 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-68250501-e902-41e0-8fa0-0bc21b298095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:22.602175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:22.699022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 858/1704] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:22.700471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250501-e902-41e0-8fa0-0bc21b298095 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:22.702669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-68250501-e902-41e0-8fa0-0bc21b298095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:22.707249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b7386-33de-4e1c-afd5-ded1f281d830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:22.708363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b7386-33de-4e1c-afd5-ded1f281d830 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:22.708363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b7386-33de-4e1c-afd5-ded1f281d830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:22.708539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b7386-33de-4e1c-afd5-ded1f281d830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:22.728161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-731b7386-33de-4e1c-afd5-ded1f281d830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:22.737603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68250501-e902-41e0-8fa0-0bc21b298095 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:22.752695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:22.753616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:22.753984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:22.754386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] PATH_INFO: `/v3/users/1f8084bdf774417080410db0a7979273` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:22.755781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8084bdf774417080410db0a7979273)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:22.758359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:22.838829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:22.880077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8084bdf774417080410db0a7979273'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.899089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8084bdf774417080410db0a7979273'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.902546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8084bdf774417080410db0a7979273'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.903616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8084bdf774417080410db0a7979273'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.920646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8084bdf774417080410db0a7979273'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:22.964792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 859/1705] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:22 2022] DELETE /identity/v3/users/1f8084bdf774417080410db0a7979273 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:22.965983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:22.971158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:22.998981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b7386-33de-4e1c-afd5-ded1f281d830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:23.000390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b7386-33de-4e1c-afd5-ded1f281d830 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:23.019325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 847/1706] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:23.125588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70262a28-1676-4039-bee9-52b53b058461 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:23.137874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:23.138768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:23.139151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:23.139551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:23.145847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:23.386863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:23.389602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:23.408025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 860/1707] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:23.704626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891a1b-4251-4cbc-813c-6806c58f928c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:23.705142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891a1b-4251-4cbc-813c-6806c58f928c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:23.705376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891a1b-4251-4cbc-813c-6806c58f928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:23.786767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0e891a1b-4251-4cbc-813c-6806c58f928c None None] MFA Rules not processed for user `1d98cbfc834a47b6ad7e1fa49357c778`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:23.788619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0e891a1b-4251-4cbc-813c-6806c58f928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:23.944561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:23.946102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:24.031145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 848/1708] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:24.050479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891a1b-4251-4cbc-813c-6806c58f928c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:24.052145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0e891a1b-4251-4cbc-813c-6806c58f928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:24.130204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:24.141606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a813b21-fcbd-4df6-a663-22c3ecea8f37 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:24.152821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f39346504314469ac21cfde56ee2157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501045e2dcea4d559fefd0ad7297e846', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:24.153462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:24.154959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:24.155076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:24.155854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:24.158841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:24.160601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:24.202274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 861/1709] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:24.219767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:24.263196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e4a5e-cb1d-4354-a682-f02571b12d9d tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:24.283201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07c43e-e7f3-492e-8ab4-c5aa297f47e3 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f39346504314469ac21cfde56ee2157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501045e2dcea4d559fefd0ad7297e846', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:24.283845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c43e-e7f3-492e-8ab4-c5aa297f47e3 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:24.284136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c43e-e7f3-492e-8ab4-c5aa297f47e3 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:24.284417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07c43e-e7f3-492e-8ab4-c5aa297f47e3 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:24.285079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07c43e-e7f3-492e-8ab4-c5aa297f47e3 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:24.292020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07c43e-e7f3-492e-8ab4-c5aa297f47e3 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:24.303055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891a1b-4251-4cbc-813c-6806c58f928c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:24.317680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0a72-583a-4f97-a3a9-e96d5fa12509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:24.318319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0a72-583a-4f97-a3a9-e96d5fa12509 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:24.318601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0a72-583a-4f97-a3a9-e96d5fa12509 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:24.322006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df0a72-583a-4f97-a3a9-e96d5fa12509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:24.333318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:24.343336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df0a72-583a-4f97-a3a9-e96d5fa12509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:24.350231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df0a72-583a-4f97-a3a9-e96d5fa12509 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:24.363956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 862/1710] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:24 2022] POST /identity/v3/projects => generated 353 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:24.365206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07c43e-e7f3-492e-8ab4-c5aa297f47e3 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:24.386007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 849/1711] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:24.575312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07c43e-e7f3-492e-8ab4-c5aa297f47e3 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:24.589832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f39346504314469ac21cfde56ee2157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501045e2dcea4d559fefd0ad7297e846', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:24.591044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:24.591567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:24.592234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:24.593823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:24.594729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:24.600709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:24.637065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 863/1712] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:24.724652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0a72-583a-4f97-a3a9-e96d5fa12509 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:24.759193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df0a72-583a-4f97-a3a9-e96d5fa12509 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:24.768548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f39346504314469ac21cfde56ee2157', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '501045e2dcea4d559fefd0ad7297e846', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:24.769709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:24.770000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:24.770283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] PATH_INFO: `/v3/projects/fa90aaf83b5e4afe8c340a9399b3d339` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:24.771775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fa90aaf83b5e4afe8c340a9399b3d339)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:24.775220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:24.932994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa90aaf83b5e4afe8c340a9399b3d339', 'request_id': 'req-eb8a3416-b534-40cd-b8dd-a455f624f573'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:24.949390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa90aaf83b5e4afe8c340a9399b3d339', 'request_id': 'req-eb8a3416-b534-40cd-b8dd-a455f624f573'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:24.968117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa90aaf83b5e4afe8c340a9399b3d339', 'request_id': 'req-eb8a3416-b534-40cd-b8dd-a455f624f573'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:25.012834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] The token cache is being invalidate because project fa90aaf83b5e4afe8c340a9399b3d339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:25.013922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:25.016173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:25.025352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 850/1713] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:24 2022] DELETE /identity/v3/projects/fa90aaf83b5e4afe8c340a9399b3d339 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:25.469149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:25.470905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:25.591948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:25.593415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:25.649145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a85b6-187d-4231-a3c0-c3a440fd0eae tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:25.773694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a3416-b534-40cd-b8dd-a455f624f573 tempest-VolumeQuotaClassesTest-1847561158 tempest-VolumeQuotaClassesTest-1847561158-project-admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:25.786772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:25.788747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:25.789854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:25.790609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] PATH_INFO: `/v3/users/d223d046a7bf470ca1fe326720897879` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:25.795507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d223d046a7bf470ca1fe326720897879)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:25.799296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:25.799985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:25.800277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:25.800555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] PATH_INFO: `/v3/users/856a7623116045d7b4e107cb3ab1d6ac` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:25.801370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:25.806589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856a7623116045d7b4e107cb3ab1d6ac)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:25.809340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:25.862185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:25.930246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd223d046a7bf470ca1fe326720897879'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:25.933155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd223d046a7bf470ca1fe326720897879'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:25.952435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856a7623116045d7b4e107cb3ab1d6ac'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:25.954584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd223d046a7bf470ca1fe326720897879'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:25.955787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd223d046a7bf470ca1fe326720897879'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:25.980464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd223d046a7bf470ca1fe326720897879'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.014840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:26.033654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856a7623116045d7b4e107cb3ab1d6ac'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.035979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856a7623116045d7b4e107cb3ab1d6ac'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.039698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 851/1714] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:25 2022] DELETE /identity/v3/users/d223d046a7bf470ca1fe326720897879 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:26.039877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856a7623116045d7b4e107cb3ab1d6ac'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.040399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:26.046453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:26.069286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856a7623116045d7b4e107cb3ab1d6ac'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.123997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 864/1715] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:25 2022] DELETE /identity/v3/users/856a7623116045d7b4e107cb3ab1d6ac => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:26.124894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:26.131833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:26.271575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee66f2-6f06-4cc7-8ba7-3cf88ff8257f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:26.329897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cece85d-35f3-41bb-accd-987cb7c9ee81 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:26.336911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:26.338406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:26.339014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:26.339727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] PATH_INFO: `/v3/projects/c307f5ba25cc4ba8873117f3ccc0195e` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:26.341900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c307f5ba25cc4ba8873117f3ccc0195e)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:26.344237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:26.488714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:26.489379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:26.489718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:26.489999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] PATH_INFO: `/v3/projects/9f9a6b60ca2a416181906189f13b49a8` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:26.496745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9a6b60ca2a416181906189f13b49a8)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:26.499083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:26.499350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c307f5ba25cc4ba8873117f3ccc0195e', 'request_id': 'req-75312861-49ce-4b05-bf36-65a4f52bb8c8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.521001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c307f5ba25cc4ba8873117f3ccc0195e', 'request_id': 'req-75312861-49ce-4b05-bf36-65a4f52bb8c8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.539399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c307f5ba25cc4ba8873117f3ccc0195e', 'request_id': 'req-75312861-49ce-4b05-bf36-65a4f52bb8c8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.574964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] The token cache is being invalidate because project c307f5ba25cc4ba8873117f3ccc0195e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:26.577461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.579935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-75312861-49ce-4b05-bf36-65a4f52bb8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.587891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 865/1716] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:26 2022] DELETE /identity/v3/projects/c307f5ba25cc4ba8873117f3ccc0195e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:26.594358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38571f3-4a2d-47ec-8e51-0d2df9653c16 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:26.594660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38571f3-4a2d-47ec-8e51-0d2df9653c16 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:26.594944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38571f3-4a2d-47ec-8e51-0d2df9653c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:26.615498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9a6b60ca2a416181906189f13b49a8', 'request_id': 'req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.637094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9a6b60ca2a416181906189f13b49a8', 'request_id': 'req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.645561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e38571f3-4a2d-47ec-8e51-0d2df9653c16 None None] MFA Rules not processed for user `c29ecb6ed0f5439482957c4365aea4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:26.646489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9a6b60ca2a416181906189f13b49a8', 'request_id': 'req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.646829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e38571f3-4a2d-47ec-8e51-0d2df9653c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:26.660384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] The token cache is being invalidate because project 9f9a6b60ca2a416181906189f13b49a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:26.661396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.662384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7c7e7610-fb71-45c0-b704-bf4885c7c7ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:26.664293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 852/1717] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:26 2022] DELETE /identity/v3/projects/9f9a6b60ca2a416181906189f13b49a8 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:26.666653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434939c-2193-4687-bae5-3b4bbf9ece64 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:26.667185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434939c-2193-4687-bae5-3b4bbf9ece64 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:26.667750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434939c-2193-4687-bae5-3b4bbf9ece64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:26.686010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:26.730843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d434939c-2193-4687-bae5-3b4bbf9ece64 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:26.732111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d434939c-2193-4687-bae5-3b4bbf9ece64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:26.781035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:26.792546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 866/1718] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:26.795872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a608e14-c3d8-4a89-b8e5-34390805d8d4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:26.796225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a608e14-c3d8-4a89-b8e5-34390805d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:26.796564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a608e14-c3d8-4a89-b8e5-34390805d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:26.821300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5a608e14-c3d8-4a89-b8e5-34390805d8d4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:26.830213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5a608e14-c3d8-4a89-b8e5-34390805d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:26.841248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 853/1719] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:26.852430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea2e5-fa12-45a9-9504-549d91f2e049 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:26.853281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea2e5-fa12-45a9-9504-549d91f2e049 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:26.853584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea2e5-fa12-45a9-9504-549d91f2e049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:26.885023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 867/1720] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:26.886256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a608e14-c3d8-4a89-b8e5-34390805d8d4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:26.896421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5a608e14-c3d8-4a89-b8e5-34390805d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:26.929324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-da8ea2e5-fa12-45a9-9504-549d91f2e049 None None] MFA Rules not processed for user `a76145d9b91d477cb13d499eccff90d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:26.930655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-da8ea2e5-fa12-45a9-9504-549d91f2e049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:26.944093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a608e14-c3d8-4a89-b8e5-34390805d8d4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:26.967068 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:26.967811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:26.968231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:26.968529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] PATH_INFO: `/v3/users/280d3bba64044848a091b3b73ade2c74` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:26.970680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=280d3bba64044848a091b3b73ade2c74)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:26.973177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:27.110517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280d3bba64044848a091b3b73ade2c74'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:27.122556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280d3bba64044848a091b3b73ade2c74'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:27.123894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280d3bba64044848a091b3b73ade2c74'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:27.125992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280d3bba64044848a091b3b73ade2c74'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:27.144730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280d3bba64044848a091b3b73ade2c74'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:27.172099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 854/1721] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:27.182117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88477516-46c2-4340-a239-07ea7eb0ead7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:27.182520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88477516-46c2-4340-a239-07ea7eb0ead7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:27.182687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88477516-46c2-4340-a239-07ea7eb0ead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:27.194736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 868/1722] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:26 2022] DELETE /identity/v3/users/280d3bba64044848a091b3b73ade2c74 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:27.195884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:27.199401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.229849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-88477516-46c2-4340-a239-07ea7eb0ead7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:27.231231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-88477516-46c2-4340-a239-07ea7eb0ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.394402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 855/1723] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:27.396106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88477516-46c2-4340-a239-07ea7eb0ead7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:27.400978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-88477516-46c2-4340-a239-07ea7eb0ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.439598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88477516-46c2-4340-a239-07ea7eb0ead7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:27.448748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d317e73-38eb-4dc1-ad17-921a49cec1fb admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:27.452627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e06f1c-a7b7-46cf-93b1-5c1009329153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:27.452627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06f1c-a7b7-46cf-93b1-5c1009329153 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:27.452972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06f1c-a7b7-46cf-93b1-5c1009329153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:27.453218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e06f1c-a7b7-46cf-93b1-5c1009329153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:27.457330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-86e06f1c-a7b7-46cf-93b1-5c1009329153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.460468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da79a86-bea4-4987-b803-facb3ec47cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:27.461294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79a86-bea4-4987-b803-facb3ec47cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:27.461754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79a86-bea4-4987-b803-facb3ec47cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:27.462869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79a86-bea4-4987-b803-facb3ec47cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:27.469384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3da79a86-bea4-4987-b803-facb3ec47cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.495689 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e06f1c-a7b7-46cf-93b1-5c1009329153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:27.500273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e06f1c-a7b7-46cf-93b1-5c1009329153 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:27.517758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da79a86-bea4-4987-b803-facb3ec47cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:27.522778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da79a86-bea4-4987-b803-facb3ec47cf4 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:27.527476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 856/1724] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:27.528859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db645e79-f8b3-4267-94e5-e3087b34e79b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:27.529156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db645e79-f8b3-4267-94e5-e3087b34e79b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:27.529496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db645e79-f8b3-4267-94e5-e3087b34e79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:27.553542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 869/1725] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:27.555179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c3d25-3ef8-4f44-8cbd-977581963291 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:27.561425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c3d25-3ef8-4f44-8cbd-977581963291 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:27.562053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c3d25-3ef8-4f44-8cbd-977581963291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:27.608079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-db645e79-f8b3-4267-94e5-e3087b34e79b None None] MFA Rules not processed for user `885ef3fa3d4d4f80be21660f52809565`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:27.609477 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-db645e79-f8b3-4267-94e5-e3087b34e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.630195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-c75c3d25-3ef8-4f44-8cbd-977581963291 None None] MFA Rules not processed for user `a76145d9b91d477cb13d499eccff90d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:27.631967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c75c3d25-3ef8-4f44-8cbd-977581963291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.714400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:27.714596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:27.792938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 870/1726] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:27.793477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efefe5-f4d9-4805-81ae-9de709c5ddbd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:27.794095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efefe5-f4d9-4805-81ae-9de709c5ddbd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:27.794095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efefe5-f4d9-4805-81ae-9de709c5ddbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:27.795067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 857/1727] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:27.797947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfcfa8-5286-4f97-a358-d91622f3941b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:27.798535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfcfa8-5286-4f97-a358-d91622f3941b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:27.801765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfcfa8-5286-4f97-a358-d91622f3941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:27.842936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b4efefe5-f4d9-4805-81ae-9de709c5ddbd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:27.844210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b4efefe5-f4d9-4805-81ae-9de709c5ddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.852674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1edfcfa8-5286-4f97-a358-d91622f3941b None None] MFA Rules not processed for user `885ef3fa3d4d4f80be21660f52809565`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:27.856119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1edfcfa8-5286-4f97-a358-d91622f3941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.869571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 871/1728] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:27.870470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efefe5-f4d9-4805-81ae-9de709c5ddbd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:27.874618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b4efefe5-f4d9-4805-81ae-9de709c5ddbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:27.885842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 858/1729] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:27.885842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfcfa8-5286-4f97-a358-d91622f3941b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:27.914766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfcfa8-5286-4f97-a358-d91622f3941b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:27.930452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:27.931771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:27.932086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:27.932427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:27.933167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:27.933566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:27.935289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:27.965644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 859/1730] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:27.970979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:27.992802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884dc0e-2b6f-4313-a970-6de7ebc4d084 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:28.003498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681abb7-10f6-4b91-a186-f60871bb0c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:28.004918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681abb7-10f6-4b91-a186-f60871bb0c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.005216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681abb7-10f6-4b91-a186-f60871bb0c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.005501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681abb7-10f6-4b91-a186-f60871bb0c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.007106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681abb7-10f6-4b91-a186-f60871bb0c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:28.012110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681abb7-10f6-4b91-a186-f60871bb0c7b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:28.061486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efefe5-f4d9-4805-81ae-9de709c5ddbd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:28.074979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:28.075711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.077430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.077794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.088406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 860/1731] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:27 2022] POST /identity/v3/projects => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:28.088902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681abb7-10f6-4b91-a186-f60871bb0c7b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:28.098338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:28.101044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:28.127247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 872/1732] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:28.299078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681abb7-10f6-4b91-a186-f60871bb0c7b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:28.319285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b22a3c-5983-42d0-9ca1-0971cdec6b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:28.320375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b22a3c-5983-42d0-9ca1-0971cdec6b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.320375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b22a3c-5983-42d0-9ca1-0971cdec6b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.320691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b22a3c-5983-42d0-9ca1-0971cdec6b90 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.322319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b22a3c-5983-42d0-9ca1-0971cdec6b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:28.324564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b22a3c-5983-42d0-9ca1-0971cdec6b90 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:28.391258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 861/1733] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:28 2022] POST /identity/v3/users => generated 279 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:39:28.393637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:28.395365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:28.395860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b22a3c-5983-42d0-9ca1-0971cdec6b90 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:28.408809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b22a3c-5983-42d0-9ca1-0971cdec6b90 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:28.416972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084c192-7e1c-4957-9a68-677aa701e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:28.417777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084c192-7e1c-4957-9a68-677aa701e678 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.418155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084c192-7e1c-4957-9a68-677aa701e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.418510 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084c192-7e1c-4957-9a68-677aa701e678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.423811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ff58c-f1ed-4048-92f4-433d00ad28d7 service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:28.425261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084c192-7e1c-4957-9a68-677aa701e678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:28.427152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084c192-7e1c-4957-9a68-677aa701e678 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:28.440941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:28.441653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.441943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.442219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] PATH_INFO: `/v3/projects/26302f6cca5c46fe8b60a6cc6c0b6744` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.443435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26302f6cca5c46fe8b60a6cc6c0b6744)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:28.445387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:28.454332 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 862/1734] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:28.459735 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084c192-7e1c-4957-9a68-677aa701e678 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:28.496780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084c192-7e1c-4957-9a68-677aa701e678 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:28.509651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eeb38-3ed0-4e43-b483-e2e47ae9be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:28.510320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eeb38-3ed0-4e43-b483-e2e47ae9be39 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.512047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eeb38-3ed0-4e43-b483-e2e47ae9be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.512262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eeb38-3ed0-4e43-b483-e2e47ae9be39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.513087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eeb38-3ed0-4e43-b483-e2e47ae9be39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:28.518353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eeb38-3ed0-4e43-b483-e2e47ae9be39 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:28.543847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 863/1735] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:28.550653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eeb38-3ed0-4e43-b483-e2e47ae9be39 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:28.572858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eeb38-3ed0-4e43-b483-e2e47ae9be39 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:28.579441 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26302f6cca5c46fe8b60a6cc6c0b6744', 'request_id': 'req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:28.595002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26302f6cca5c46fe8b60a6cc6c0b6744', 'request_id': 'req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:28.614303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26302f6cca5c46fe8b60a6cc6c0b6744', 'request_id': 'req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:28.640560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] The token cache is being invalidate because project 26302f6cca5c46fe8b60a6cc6c0b6744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:28.640768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:28.642322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-397959d6-cba1-4c7c-b40d-fdf2c16c56f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:28.649244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 873/1736] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:28 2022] DELETE /identity/v3/projects/26302f6cca5c46fe8b60a6cc6c0b6744 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:39:28.651625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fbe86-b0a1-4431-8e5b-a10b9da0094d None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.652094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fbe86-b0a1-4431-8e5b-a10b9da0094d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.653073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fbe86-b0a1-4431-8e5b-a10b9da0094d None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.656156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 874/1737] 10.222.0.17 () {54 vars in 912 bytes} [Mon Oct 3 12:39:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:39:28.657846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97509064-2168-46f6-a6dc-3a87c9813646 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.658375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97509064-2168-46f6-a6dc-3a87c9813646 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.658972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97509064-2168-46f6-a6dc-3a87c9813646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.695092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-97509064-2168-46f6-a6dc-3a87c9813646 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:28.701726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-97509064-2168-46f6-a6dc-3a87c9813646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:28.723223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeece5-6b4b-465f-ae06-2c094611edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:28.723223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeece5-6b4b-465f-ae06-2c094611edf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.723223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeece5-6b4b-465f-ae06-2c094611edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.723223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeece5-6b4b-465f-ae06-2c094611edf1 admin admin] PATH_INFO: `/v3/projects/f3122f8764f54f50a5963df4af37a9fb/users/04a5495b3dc34c35931fd141a4542e9b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.743526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:28.755691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feeece5-6b4b-465f-ae06-2c094611edf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3122f8764f54f50a5963df4af37a9fb, user_id=04a5495b3dc34c35931fd141a4542e9b, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:28.760071 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feeece5-6b4b-465f-ae06-2c094611edf1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:28.805765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 864/1738] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:28 2022] PUT /identity/v3/projects/f3122f8764f54f50a5963df4af37a9fb/users/04a5495b3dc34c35931fd141a4542e9b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:28.809652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421288f-4af2-4620-971d-f20c7bf9248a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.809846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:28.810393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421288f-4af2-4620-971d-f20c7bf9248a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.812216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421288f-4af2-4620-971d-f20c7bf9248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.917529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 875/1739] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:28.921463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19144717-c835-4d0c-b320-7e9c180e0973 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:28.922039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19144717-c835-4d0c-b320-7e9c180e0973 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:28.923234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19144717-c835-4d0c-b320-7e9c180e0973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:28.928439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2421288f-4af2-4620-971d-f20c7bf9248a None None] MFA Rules not processed for user `323b7d02f817475791098f32bf1c953e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:28.930917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2421288f-4af2-4620-971d-f20c7bf9248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:28.972833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-19144717-c835-4d0c-b320-7e9c180e0973 None None] MFA Rules not processed for user `04a5495b3dc34c35931fd141a4542e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:28.974477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-19144717-c835-4d0c-b320-7e9c180e0973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.064894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 865/1740] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:29.067616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c720-c517-4ed5-84b4-f55da9c05e22 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.068294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c720-c517-4ed5-84b4-f55da9c05e22 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.068925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66c720-c517-4ed5-84b4-f55da9c05e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.114689 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6d66c720-c517-4ed5-84b4-f55da9c05e22 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:29.117103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6d66c720-c517-4ed5-84b4-f55da9c05e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.125500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 876/1741] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:29.127470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214dca-01d3-48e2-8e50-0e4507afb0a7 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.127470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214dca-01d3-48e2-8e50-0e4507afb0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.127630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214dca-01d3-48e2-8e50-0e4507afb0a7 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.129078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 877/1742] 10.222.0.17 () {54 vars in 912 bytes} [Mon Oct 3 12:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:39:29.142567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214dca-01d3-48e2-8e50-0e4507afb0a7 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:29.150894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3d214dca-01d3-48e2-8e50-0e4507afb0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.170053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214dca-01d3-48e2-8e50-0e4507afb0a7 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:29.175661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208eae31-f2dc-4b86-8093-6dccad52a1a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:29.176525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eae31-f2dc-4b86-8093-6dccad52a1a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.176886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eae31-f2dc-4b86-8093-6dccad52a1a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.177237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eae31-f2dc-4b86-8093-6dccad52a1a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.192289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208eae31-f2dc-4b86-8093-6dccad52a1a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:29.195487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208eae31-f2dc-4b86-8093-6dccad52a1a2 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:29.217475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 878/1743] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:29.218790 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b09d0-941c-4816-bf7a-42e9d0eb68f4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.219102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b09d0-941c-4816-bf7a-42e9d0eb68f4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.219589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b09d0-941c-4816-bf7a-42e9d0eb68f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.268901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-132b09d0-941c-4816-bf7a-42e9d0eb68f4 None None] MFA Rules not processed for user `1d98cbfc834a47b6ad7e1fa49357c778`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:29.271526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-132b09d0-941c-4816-bf7a-42e9d0eb68f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.293124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 866/1744] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:29.294378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c720-c517-4ed5-84b4-f55da9c05e22 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:29.298541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6d66c720-c517-4ed5-84b4-f55da9c05e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.324678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66c720-c517-4ed5-84b4-f55da9c05e22 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:29.340230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fabd8-5860-4f50-9937-9d135c748b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:29.340880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fabd8-5860-4f50-9937-9d135c748b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.341167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fabd8-5860-4f50-9937-9d135c748b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.341787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fabd8-5860-4f50-9937-9d135c748b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.342493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fabd8-5860-4f50-9937-9d135c748b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:29.344490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fabd8-5860-4f50-9937-9d135c748b67 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:29.422099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 879/1745] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:29.423731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 867/1746] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:29 2022] POST /identity/v3/projects => generated 353 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:29.427108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fabd8-5860-4f50-9937-9d135c748b67 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:29.427216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072b5f3-5f06-4c1e-acd4-c9277cdf9385 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.427216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072b5f3-5f06-4c1e-acd4-c9277cdf9385 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.427216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072b5f3-5f06-4c1e-acd4-c9277cdf9385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.481455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5072b5f3-5f06-4c1e-acd4-c9277cdf9385 None None] MFA Rules not processed for user `323b7d02f817475791098f32bf1c953e`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:29.511157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5072b5f3-5f06-4c1e-acd4-c9277cdf9385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.585833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fabd8-5860-4f50-9937-9d135c748b67 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:29.599027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:29.600311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.601261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.601690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.603327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:29.603826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:29.605870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:29.609994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 880/1747] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:29.612502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072b5f3-5f06-4c1e-acd4-c9277cdf9385 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:29.614763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5072b5f3-5f06-4c1e-acd4-c9277cdf9385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.617682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:29.628294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 868/1748] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:29.628745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:29.639039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072b5f3-5f06-4c1e-acd4-c9277cdf9385 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:29.645654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91641065-dbd5-4fe8-9a75-fb900fb10543 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:29.646424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:29.647583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.647861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.648228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] PATH_INFO: `/v3/projects/c3b5e2bb0f5a4522adad5ff2351f9c34` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.650225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b5e2bb0f5a4522adad5ff2351f9c34)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:29.653414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:29.657803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:29.657981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:29.658576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.658989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.659104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.659773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:29.662692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:29.714404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 869/1749] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:29 2022] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:29.717625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:29.720095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.754629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd35d0-d32b-4bb0-a856-82ffb41bb75b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:29.769061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b5e2bb0f5a4522adad5ff2351f9c34', 'request_id': 'req-f99c5060-70f1-469b-aa73-a24ab6a51b37'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:29.786728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b5e2bb0f5a4522adad5ff2351f9c34', 'request_id': 'req-f99c5060-70f1-469b-aa73-a24ab6a51b37'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:29.807634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b5e2bb0f5a4522adad5ff2351f9c34', 'request_id': 'req-f99c5060-70f1-469b-aa73-a24ab6a51b37'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:29.830380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] The token cache is being invalidate because project c3b5e2bb0f5a4522adad5ff2351f9c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:29.830671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:29.831363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:29.833535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 881/1750] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:29 2022] DELETE /identity/v3/projects/c3b5e2bb0f5a4522adad5ff2351f9c34 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:29.834426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:29.835846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:29.884110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:29.886175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:29.886718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:29.887284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] PATH_INFO: `/v3/projects/931e1d94ac0d4f6395167f4e029997e2` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:29.895191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=931e1d94ac0d4f6395167f4e029997e2)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:29.905933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:29.993882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '931e1d94ac0d4f6395167f4e029997e2', 'request_id': 'req-35478cbb-6608-4ba6-bfbb-20720166a5db'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.001679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5060-70f1-469b-aa73-a24ab6a51b37 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:30.012518 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '931e1d94ac0d4f6395167f4e029997e2', 'request_id': 'req-35478cbb-6608-4ba6-bfbb-20720166a5db'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.029676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '931e1d94ac0d4f6395167f4e029997e2', 'request_id': 'req-35478cbb-6608-4ba6-bfbb-20720166a5db'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.056410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] The token cache is being invalidate because project 931e1d94ac0d4f6395167f4e029997e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:30.057135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.059146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.063168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 870/1751] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:29 2022] DELETE /identity/v3/projects/931e1d94ac0d4f6395167f4e029997e2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:30.064805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:30.067327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.098000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:30.103477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.103774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.104139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.104766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:30.106759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:30.166689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 882/1752] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:29 2022] POST /identity/v3/projects => generated 387 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:30.167353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:30.177466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.195023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35478cbb-6608-4ba6-bfbb-20720166a5db admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:30.228736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:30.237451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:30.275111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b83bf-65e5-4a39-a84c-ac60a3c27554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:30.276112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b83bf-65e5-4a39-a84c-ac60a3c27554 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.276403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b83bf-65e5-4a39-a84c-ac60a3c27554 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.276851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b83bf-65e5-4a39-a84c-ac60a3c27554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.279660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-796b83bf-65e5-4a39-a84c-ac60a3c27554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.289710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b83bf-65e5-4a39-a84c-ac60a3c27554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:30.291844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b83bf-65e5-4a39-a84c-ac60a3c27554 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:30.295058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facebb6b-2792-4b04-b5f0-2d7ed9a8861b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:30.300843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:30.301037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 871/1753] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:30.301654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.302123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca4b9-78c1-4f29-b8aa-f07864144745 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.302247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.302340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca4b9-78c1-4f29-b8aa-f07864144745 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.302427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.302570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfca4b9-78c1-4f29-b8aa-f07864144745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.303070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:30.305307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:30.322209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 883/1754] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:30.322209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:30.322209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.327412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cbfca4b9-78c1-4f29-b8aa-f07864144745 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:30.329099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cbfca4b9-78c1-4f29-b8aa-f07864144745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.348424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 872/1755] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:30.349582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca4b9-78c1-4f29-b8aa-f07864144745 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:30.352665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cbfca4b9-78c1-4f29-b8aa-f07864144745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.429235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9696f4d-88fd-4601-b079-d14176e3f82b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:30.437483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:30.438698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.439009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.439295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.441335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfca4b9-78c1-4f29-b8aa-f07864144745 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:30.441995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.454087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:30.454889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.455297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.455683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.458047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.471667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:30.473458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:30.486183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 873/1756] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:30.487289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:30.488935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.503936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb0f74-9738-41aa-a3c2-0475b6642a9b service placement] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:30.509872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:30.510676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.511217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.511603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] PATH_INFO: `/v3/users/4f39346504314469ac21cfde56ee2157` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.512954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f39346504314469ac21cfde56ee2157)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:30.515062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:30.576378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:30.578059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:30.579884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f39346504314469ac21cfde56ee2157'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.580699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f39346504314469ac21cfde56ee2157'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.589608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f39346504314469ac21cfde56ee2157'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.590734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f39346504314469ac21cfde56ee2157'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.604872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 884/1757] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:30.605255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:30.610367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.616493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f39346504314469ac21cfde56ee2157'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:30.645354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977b3ae-10a2-4d8c-b457-18ab0c34b3c5 service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:30.659218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674e7b7-f567-4b96-9317-c00493830700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:30.659860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e7b7-f567-4b96-9317-c00493830700 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.660147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e7b7-f567-4b96-9317-c00493830700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.660545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674e7b7-f567-4b96-9317-c00493830700 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.661202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674e7b7-f567-4b96-9317-c00493830700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:30.666117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674e7b7-f567-4b96-9317-c00493830700 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:30.668988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 874/1758] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:30 2022] DELETE /identity/v3/users/4f39346504314469ac21cfde56ee2157 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:30.672831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:30.674566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.744075 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 885/1759] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:30 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:30.745603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af035e5-6cfc-4133-8603-2db75c4788a0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.746150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af035e5-6cfc-4133-8603-2db75c4788a0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.746442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af035e5-6cfc-4133-8603-2db75c4788a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.751323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:30.787944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-4af035e5-6cfc-4133-8603-2db75c4788a0 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:30.789270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4af035e5-6cfc-4133-8603-2db75c4788a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:30.854862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ac5ee-d36a-4b77-83df-9914b2a38e61 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:30.867228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:30.869811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:30.871315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:30.871703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] PATH_INFO: `/v3/projects/d448c6f1608f4526b681507cd9736c12/users/03c247d3dda9467483b9e23b0fe451c4/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:30.908896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:30.916777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d448c6f1608f4526b681507cd9736c12, user_id=03c247d3dda9467483b9e23b0fe451c4, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:30.919996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:30.963584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 875/1760] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:30 2022] PUT /identity/v3/projects/d448c6f1608f4526b681507cd9736c12/users/03c247d3dda9467483b9e23b0fe451c4/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:30.972249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:30.976951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:31.054994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 886/1761] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:31.056605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af035e5-6cfc-4133-8603-2db75c4788a0 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:31.091624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af035e5-6cfc-4133-8603-2db75c4788a0 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:31.221671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85781f3b-9010-405b-af43-77ba25ebc0d7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:31.234674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828f1bf-6852-453d-84a9-4e0d2841780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:31.235420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f1bf-6852-453d-84a9-4e0d2841780e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.235801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f1bf-6852-453d-84a9-4e0d2841780e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.236087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828f1bf-6852-453d-84a9-4e0d2841780e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.237086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828f1bf-6852-453d-84a9-4e0d2841780e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:31.239143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828f1bf-6852-453d-84a9-4e0d2841780e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:31.255756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 876/1762] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:31.255756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828f1bf-6852-453d-84a9-4e0d2841780e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:31.263386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f61d-8f76-44b1-a6b0-2dd34f0bcb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:31.267493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f61d-8f76-44b1-a6b0-2dd34f0bcb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.267866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f61d-8f76-44b1-a6b0-2dd34f0bcb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.269109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828f1bf-6852-453d-84a9-4e0d2841780e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:31.269234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f61d-8f76-44b1-a6b0-2dd34f0bcb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.270215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87f61d-8f76-44b1-a6b0-2dd34f0bcb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:31.275009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:31.275655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87f61d-8f76-44b1-a6b0-2dd34f0bcb17 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:31.275795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.276135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.276505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.277372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:31.277572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:31.279321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:31.299936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 877/1763] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:31.301059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:31.311485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 887/1764] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:31.313686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f61d-8f76-44b1-a6b0-2dd34f0bcb17 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:31.318198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db468c0e-02dc-4910-9678-96f90323c860 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:31.333075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90be21-1a98-4f83-b415-0092224fcec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:31.334193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90be21-1a98-4f83-b415-0092224fcec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.334616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90be21-1a98-4f83-b415-0092224fcec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.334975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90be21-1a98-4f83-b415-0092224fcec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.336255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90be21-1a98-4f83-b415-0092224fcec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:31.336650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f61d-8f76-44b1-a6b0-2dd34f0bcb17 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:31.338795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90be21-1a98-4f83-b415-0092224fcec5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:31.347120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd5a6-ee54-434a-93e6-475b60d1f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:31.347877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd5a6-ee54-434a-93e6-475b60d1f701 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.348144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd5a6-ee54-434a-93e6-475b60d1f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.348424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefd5a6-ee54-434a-93e6-475b60d1f701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.352237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefd5a6-ee54-434a-93e6-475b60d1f701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:31.361268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefd5a6-ee54-434a-93e6-475b60d1f701 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:31.367928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 878/1765] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:31.367928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90be21-1a98-4f83-b415-0092224fcec5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:31.378748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90be21-1a98-4f83-b415-0092224fcec5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:31.385193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e08fb8-11d0-4727-ae8d-e10b46c7c65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:31.386300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e08fb8-11d0-4727-ae8d-e10b46c7c65f admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.387187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e08fb8-11d0-4727-ae8d-e10b46c7c65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.387676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e08fb8-11d0-4727-ae8d-e10b46c7c65f admin admin] PATH_INFO: `/v3/projects/d448c6f1608f4526b681507cd9736c12/users/03c247d3dda9467483b9e23b0fe451c4/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.390366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e08fb8-11d0-4727-ae8d-e10b46c7c65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d448c6f1608f4526b681507cd9736c12, user_id=03c247d3dda9467483b9e23b0fe451c4, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:31.396732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e08fb8-11d0-4727-ae8d-e10b46c7c65f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:31.412954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 888/1766] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:31 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:31.413996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd5a6-ee54-434a-93e6-475b60d1f701 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:31.429230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 879/1767] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:31 2022] PUT /identity/v3/projects/d448c6f1608f4526b681507cd9736c12/users/03c247d3dda9467483b9e23b0fe451c4/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:31.441901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e08fb8-11d0-4727-ae8d-e10b46c7c65f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:31.612036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefd5a6-ee54-434a-93e6-475b60d1f701 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:31.627154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed734c-66e7-4cfc-82f2-774395975be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:31.627849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed734c-66e7-4cfc-82f2-774395975be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.628132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed734c-66e7-4cfc-82f2-774395975be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.628553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed734c-66e7-4cfc-82f2-774395975be1 admin admin] PATH_INFO: `/v3/projects/373c34e60db140e3af4d2a1440326a6b/users/b32a0bbf2cc4407c9e7feda9a3f188d6/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.638874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e08fb8-11d0-4727-ae8d-e10b46c7c65f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:31.651945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e1757-a601-4609-839e-6a95490328aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:31.652576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1757-a601-4609-839e-6a95490328aa admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.652934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1757-a601-4609-839e-6a95490328aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.653134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e1757-a601-4609-839e-6a95490328aa admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.653849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1757-a601-4609-839e-6a95490328aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:31.655907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e1757-a601-4609-839e-6a95490328aa admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:31.659944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed734c-66e7-4cfc-82f2-774395975be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373c34e60db140e3af4d2a1440326a6b, user_id=b32a0bbf2cc4407c9e7feda9a3f188d6, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:31.662702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed734c-66e7-4cfc-82f2-774395975be1 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:31.679112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:31.700129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 889/1768] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:31 2022] PUT /identity/v3/projects/373c34e60db140e3af4d2a1440326a6b/users/b32a0bbf2cc4407c9e7feda9a3f188d6/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:31.701776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178b20e-31c4-40ef-ba69-a36a29dfd99f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.702068 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178b20e-31c4-40ef-ba69-a36a29dfd99f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.702387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178b20e-31c4-40ef-ba69-a36a29dfd99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.723573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 880/1769] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:31 2022] POST /identity/v3/users => generated 287 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:31.730819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7aaec-1909-47b5-bafa-acf93de575d2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:31.731606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7aaec-1909-47b5-bafa-acf93de575d2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:31.734281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7aaec-1909-47b5-bafa-acf93de575d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:31.754523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1178b20e-31c4-40ef-ba69-a36a29dfd99f None None] MFA Rules not processed for user `03c247d3dda9467483b9e23b0fe451c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:31.758311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1178b20e-31c4-40ef-ba69-a36a29dfd99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:31.797691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-52f7aaec-1909-47b5-bafa-acf93de575d2 None None] MFA Rules not processed for user `b32a0bbf2cc4407c9e7feda9a3f188d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:31.799064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-52f7aaec-1909-47b5-bafa-acf93de575d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:31.837588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:31.949191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 890/1770] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:31.951041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178b20e-31c4-40ef-ba69-a36a29dfd99f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:31.998873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 881/1771] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:31.998873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7aaec-1909-47b5-bafa-acf93de575d2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:32.007346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-52f7aaec-1909-47b5-bafa-acf93de575d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:32.130772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178b20e-31c4-40ef-ba69-a36a29dfd99f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:32.167793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:32.168583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:32.168866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:32.169140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:32.171223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7aaec-1909-47b5-bafa-acf93de575d2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:32.176753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:32.177339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:32.178512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:32.178857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:32.179206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:32.179312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] PATH_INFO: `/v3/projects/501045e2dcea4d559fefd0ad7297e846` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:32.181614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501045e2dcea4d559fefd0ad7297e846)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:32.183672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:32.219161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 891/1772] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:32.220796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:32.235393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:32.293308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501045e2dcea4d559fefd0ad7297e846', 'request_id': 'req-f243de77-98b6-4342-a701-5578dede6604'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:32.312354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501045e2dcea4d559fefd0ad7297e846', 'request_id': 'req-f243de77-98b6-4342-a701-5578dede6604'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:32.344502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501045e2dcea4d559fefd0ad7297e846', 'request_id': 'req-f243de77-98b6-4342-a701-5578dede6604'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:32.390348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] The token cache is being invalidate because project 501045e2dcea4d559fefd0ad7297e846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:32.390677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:32.391392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:32.398109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 882/1773] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:31 2022] DELETE /identity/v3/projects/501045e2dcea4d559fefd0ad7297e846 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:32.398997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:32.408787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:32.481717 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e35322-a901-4701-a48f-ba748b70ad57 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:32.487060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:32.662622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243de77-98b6-4342-a701-5578dede6604 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:32.666424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929e1cf-f2b6-4504-9e45-8897dbb2a4d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:32.667066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e1cf-f2b6-4504-9e45-8897dbb2a4d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:32.667405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e1cf-f2b6-4504-9e45-8897dbb2a4d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:32.667659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e1cf-f2b6-4504-9e45-8897dbb2a4d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:32.671038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1929e1cf-f2b6-4504-9e45-8897dbb2a4d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:32.674739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:32.675376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:32.676304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:32.676598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:32.677256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:32.683857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:32.738445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:32.745051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 883/1774] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:32 2022] POST /identity/v3/projects => generated 385 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:32.752118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:32.758853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:32.834125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929e1cf-f2b6-4504-9e45-8897dbb2a4d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:32.839137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929e1cf-f2b6-4504-9e45-8897dbb2a4d5 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:32.887850 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 892/1775] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:32.890711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b8eb-7433-447a-9b5d-a0614cb380db None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:32.890997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b8eb-7433-447a-9b5d-a0614cb380db None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:32.891272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b8eb-7433-447a-9b5d-a0614cb380db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:32.963028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-bce5b8eb-7433-447a-9b5d-a0614cb380db None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:32.965628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0f51a-7913-47f0-afc4-934a6107423e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:32.967292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-bce5b8eb-7433-447a-9b5d-a0614cb380db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:32.985100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7febca-d628-412a-8000-ff5b39de8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:32.987291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7febca-d628-412a-8000-ff5b39de8f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:32.989068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7febca-d628-412a-8000-ff5b39de8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:32.989508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7febca-d628-412a-8000-ff5b39de8f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:32.990373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7febca-d628-412a-8000-ff5b39de8f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:32.999187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 893/1776] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:32.999187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5b8eb-7433-447a-9b5d-a0614cb380db None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:33.003142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7febca-d628-412a-8000-ff5b39de8f25 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:33.032464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5b8eb-7433-447a-9b5d-a0614cb380db None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:33.044541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69808202-971d-4886-bfba-c82552239498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:33.044541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808202-971d-4886-bfba-c82552239498 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.044541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808202-971d-4886-bfba-c82552239498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.044541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69808202-971d-4886-bfba-c82552239498 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.044941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69808202-971d-4886-bfba-c82552239498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:33.044941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69808202-971d-4886-bfba-c82552239498 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:33.047125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 884/1777] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:33.058207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005040-b047-4430-8a07-85228f5b0833 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.059918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005040-b047-4430-8a07-85228f5b0833 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.060236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005040-b047-4430-8a07-85228f5b0833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.087721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 894/1778] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:32 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:33.088829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69808202-971d-4886-bfba-c82552239498 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:33.116378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69808202-971d-4886-bfba-c82552239498 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:33.124361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec8a6c-8a6c-4ee5-9f59-6f92660e2668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:33.125853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec8a6c-8a6c-4ee5-9f59-6f92660e2668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.126228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec8a6c-8a6c-4ee5-9f59-6f92660e2668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.126688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec8a6c-8a6c-4ee5-9f59-6f92660e2668 admin admin] PATH_INFO: `/v3/projects/32fb66e344ef4706ab2971dc01cf5b39/users/a1d7e021f532488091fe68d2bdf35b98/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.137497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-27005040-b047-4430-8a07-85228f5b0833 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:33.138591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-27005040-b047-4430-8a07-85228f5b0833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:33.160799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec8a6c-8a6c-4ee5-9f59-6f92660e2668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fb66e344ef4706ab2971dc01cf5b39, user_id=a1d7e021f532488091fe68d2bdf35b98, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:33.168613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec8a6c-8a6c-4ee5-9f59-6f92660e2668 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:33.172471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 885/1779] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:33.173509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005040-b047-4430-8a07-85228f5b0833 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:33.178596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-27005040-b047-4430-8a07-85228f5b0833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:33.219973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 895/1780] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:33 2022] PUT /identity/v3/projects/32fb66e344ef4706ab2971dc01cf5b39/users/a1d7e021f532488091fe68d2bdf35b98/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:33.221693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec8a6c-8a6c-4ee5-9f59-6f92660e2668 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:33.359508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005040-b047-4430-8a07-85228f5b0833 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:33.451269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec8a6c-8a6c-4ee5-9f59-6f92660e2668 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:33.457747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3d7a6-35c8-4f3e-aa32-6e2f3fb9dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:33.458593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3d7a6-35c8-4f3e-aa32-6e2f3fb9dbaf admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.459306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3d7a6-35c8-4f3e-aa32-6e2f3fb9dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.459791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3d7a6-35c8-4f3e-aa32-6e2f3fb9dbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.463907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:33.466539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3d7a6-35c8-4f3e-aa32-6e2f3fb9dbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:33.472697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3d7a6-35c8-4f3e-aa32-6e2f3fb9dbaf admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:33.480592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:33.481537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.481720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.482004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.483891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:33.497603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 896/1781] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:33.499746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b822-593a-44df-a415-545fbdb87367 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.500270 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b822-593a-44df-a415-545fbdb87367 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.500823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b822-593a-44df-a415-545fbdb87367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.532799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5af9b822-593a-44df-a415-545fbdb87367 None None] MFA Rules not processed for user `a76145d9b91d477cb13d499eccff90d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:33.535945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5af9b822-593a-44df-a415-545fbdb87367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:33.592222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:33.596145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:33.607711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 886/1782] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:33.608944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:33.622431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e82a2-2dac-4f40-880c-0b3c46c79e25 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:33.628012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413723b-36b7-4ca0-8ce1-dbb42583e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:33.628980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413723b-36b7-4ca0-8ce1-dbb42583e1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.629407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413723b-36b7-4ca0-8ce1-dbb42583e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.630015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413723b-36b7-4ca0-8ce1-dbb42583e1fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.631001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413723b-36b7-4ca0-8ce1-dbb42583e1fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:33.631844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413723b-36b7-4ca0-8ce1-dbb42583e1fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:33.634642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413723b-36b7-4ca0-8ce1-dbb42583e1fd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:33.652086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 887/1783] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:33.653847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab65731-6e7e-495b-becc-72679abc724a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.654291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab65731-6e7e-495b-becc-72679abc724a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.654697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab65731-6e7e-495b-becc-72679abc724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.701850 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6ab65731-6e7e-495b-becc-72679abc724a None None] MFA Rules not processed for user `a1d7e021f532488091fe68d2bdf35b98`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:33.704189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6ab65731-6e7e-495b-becc-72679abc724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:33.772293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 897/1784] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:33.773597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9b822-593a-44df-a415-545fbdb87367 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:33.823317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9b822-593a-44df-a415-545fbdb87367 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:33.855624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550582d-98ca-4bf9-ba91-cd091fec233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:33.856319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550582d-98ca-4bf9-ba91-cd091fec233c admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.856605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550582d-98ca-4bf9-ba91-cd091fec233c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.856885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550582d-98ca-4bf9-ba91-cd091fec233c admin admin] PATH_INFO: `/v3/projects/4ffd21ec4bcd43339724ca0ebba7a8a1/users/45ca8d2dab6c462cb75f4224cac8fb46/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.921662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 888/1785] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:33.921662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab65731-6e7e-495b-becc-72679abc724a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:33.944045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab65731-6e7e-495b-becc-72679abc724a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:33.944283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550582d-98ca-4bf9-ba91-cd091fec233c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffd21ec4bcd43339724ca0ebba7a8a1, user_id=45ca8d2dab6c462cb75f4224cac8fb46, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:33.953886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550582d-98ca-4bf9-ba91-cd091fec233c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:33.956263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55997-cbc8-4f7c-a8c9-a55face481f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:33.957161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55997-cbc8-4f7c-a8c9-a55face481f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:33.957596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:33.958647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55997-cbc8-4f7c-a8c9-a55face481f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:33.959094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55997-cbc8-4f7c-a8c9-a55face481f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:33.959906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e55997-cbc8-4f7c-a8c9-a55face481f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:33.963591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e55997-cbc8-4f7c-a8c9-a55face481f2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:34.001155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 898/1786] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:33 2022] PUT /identity/v3/projects/4ffd21ec4bcd43339724ca0ebba7a8a1/users/45ca8d2dab6c462cb75f4224cac8fb46/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:34.002597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550582d-98ca-4bf9-ba91-cd091fec233c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:34.065556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 889/1787] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:33 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:34.067726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55997-cbc8-4f7c-a8c9-a55face481f2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:34.227133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550582d-98ca-4bf9-ba91-cd091fec233c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:34.276349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:34.288180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55997-cbc8-4f7c-a8c9-a55face481f2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:34.296873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759746b1-a1d4-44bb-ab83-66e6f08b65e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:34.297879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759746b1-a1d4-44bb-ab83-66e6f08b65e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:34.298526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759746b1-a1d4-44bb-ab83-66e6f08b65e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:34.298956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759746b1-a1d4-44bb-ab83-66e6f08b65e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:34.301461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759746b1-a1d4-44bb-ab83-66e6f08b65e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:34.306028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759746b1-a1d4-44bb-ab83-66e6f08b65e1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:34.332519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 890/1788] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:34.335138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759746b1-a1d4-44bb-ab83-66e6f08b65e1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:34.388111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759746b1-a1d4-44bb-ab83-66e6f08b65e1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:34.394188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b97af3-be3e-4bc6-9a99-0033de64e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:34.394902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b97af3-be3e-4bc6-9a99-0033de64e8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:34.395395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b97af3-be3e-4bc6-9a99-0033de64e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:34.397309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b97af3-be3e-4bc6-9a99-0033de64e8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:34.398546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b97af3-be3e-4bc6-9a99-0033de64e8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:34.406873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b97af3-be3e-4bc6-9a99-0033de64e8b0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:34.465846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 891/1789] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:34 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:34.468161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b97af3-be3e-4bc6-9a99-0033de64e8b0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:34.488881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646ec7-3e49-4c09-97d6-4d874885a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:34.494289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646ec7-3e49-4c09-97d6-4d874885a75c admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:34.494675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646ec7-3e49-4c09-97d6-4d874885a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:34.495025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646ec7-3e49-4c09-97d6-4d874885a75c admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:34.497911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e646ec7-3e49-4c09-97d6-4d874885a75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:34.502412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e646ec7-3e49-4c09-97d6-4d874885a75c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:34.503586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b97af3-be3e-4bc6-9a99-0033de64e8b0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:34.526984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6710be-3a1b-4de5-9585-d1367dd60ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:34.530586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6710be-3a1b-4de5-9585-d1367dd60ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:34.532332 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6710be-3a1b-4de5-9585-d1367dd60ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:34.533206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6710be-3a1b-4de5-9585-d1367dd60ee0 admin admin] PATH_INFO: `/v3/projects/4ffd21ec4bcd43339724ca0ebba7a8a1/users/45ca8d2dab6c462cb75f4224cac8fb46/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:34.541505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6710be-3a1b-4de5-9585-d1367dd60ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffd21ec4bcd43339724ca0ebba7a8a1, user_id=45ca8d2dab6c462cb75f4224cac8fb46, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:34.557349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6710be-3a1b-4de5-9585-d1367dd60ee0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:34.612432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 892/1790] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:34 2022] PUT /identity/v3/projects/4ffd21ec4bcd43339724ca0ebba7a8a1/users/45ca8d2dab6c462cb75f4224cac8fb46/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:34.612432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6710be-3a1b-4de5-9585-d1367dd60ee0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:34.612815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 899/1791] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:34 2022] POST /identity/v3/projects => generated 373 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:34.612815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646ec7-3e49-4c09-97d6-4d874885a75c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:34.814628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646ec7-3e49-4c09-97d6-4d874885a75c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:34.834077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b27b14-559c-4fcd-bb05-ef3cbab329b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:34.836848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27b14-559c-4fcd-bb05-ef3cbab329b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:34.837023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6710be-3a1b-4de5-9585-d1367dd60ee0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:34.837723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27b14-559c-4fcd-bb05-ef3cbab329b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:34.838529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b27b14-559c-4fcd-bb05-ef3cbab329b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:34.843090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b27b14-559c-4fcd-bb05-ef3cbab329b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:34.849966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b27b14-559c-4fcd-bb05-ef3cbab329b4 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:34.865217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c45c3-81e0-4af2-86e5-252a34de97c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:34.865877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c45c3-81e0-4af2-86e5-252a34de97c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:34.866157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c45c3-81e0-4af2-86e5-252a34de97c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:34.866434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c45c3-81e0-4af2-86e5-252a34de97c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:34.867142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c45c3-81e0-4af2-86e5-252a34de97c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:34.869330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c45c3-81e0-4af2-86e5-252a34de97c4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:34.892245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 900/1792] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:34 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:34.893333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce16e96-518a-4ff1-a739-b8f42432e28c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:34.893677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce16e96-518a-4ff1-a739-b8f42432e28c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:34.893961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce16e96-518a-4ff1-a739-b8f42432e28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:34.908864 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 893/1793] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:34.910452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c45c3-81e0-4af2-86e5-252a34de97c4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:34.936180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c45c3-81e0-4af2-86e5-252a34de97c4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:34.948292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa8c2-f5d1-4472-a2b3-82858d3aaa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:34.948939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa8c2-f5d1-4472-a2b3-82858d3aaa65 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:34.949225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa8c2-f5d1-4472-a2b3-82858d3aaa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:34.949502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa8c2-f5d1-4472-a2b3-82858d3aaa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:34.950187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aa8c2-f5d1-4472-a2b3-82858d3aaa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:34.953865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aa8c2-f5d1-4472-a2b3-82858d3aaa65 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:34.970508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7ce16e96-518a-4ff1-a739-b8f42432e28c None None] MFA Rules not processed for user `45ca8d2dab6c462cb75f4224cac8fb46`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:34.974590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7ce16e96-518a-4ff1-a739-b8f42432e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:34.997441 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:34.997639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 894/1794] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:35.000824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa8c2-f5d1-4472-a2b3-82858d3aaa65 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:35.027770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa8c2-f5d1-4472-a2b3-82858d3aaa65 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:35.041759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f6fc-f527-4cbe-9c87-13cdbad69186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:35.041985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f6fc-f527-4cbe-9c87-13cdbad69186 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:35.042218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f6fc-f527-4cbe-9c87-13cdbad69186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:35.047454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f6fc-f527-4cbe-9c87-13cdbad69186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:35.062231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760f6fc-f527-4cbe-9c87-13cdbad69186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:35.071419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760f6fc-f527-4cbe-9c87-13cdbad69186 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:35.127114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 895/1795] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:35.130526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f6fc-f527-4cbe-9c87-13cdbad69186 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:35.169845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f6fc-f527-4cbe-9c87-13cdbad69186 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:35.209169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd00e6-15fd-4af7-8c0e-42901be85d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:35.209968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd00e6-15fd-4af7-8c0e-42901be85d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:35.210324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd00e6-15fd-4af7-8c0e-42901be85d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:35.210673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd00e6-15fd-4af7-8c0e-42901be85d23 admin admin] PATH_INFO: `/v3/projects/4d73ec9631b04d4289896ee1c1aeffd0/users/27214940465742d7994f77fc35d5efe4/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:35.226757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 901/1796] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:35.229530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce16e96-518a-4ff1-a739-b8f42432e28c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:35.254121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd00e6-15fd-4af7-8c0e-42901be85d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d73ec9631b04d4289896ee1c1aeffd0, user_id=27214940465742d7994f77fc35d5efe4, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:35.262048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd00e6-15fd-4af7-8c0e-42901be85d23 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:35.286693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce16e96-518a-4ff1-a739-b8f42432e28c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:35.315702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 896/1797] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:35 2022] PUT /identity/v3/projects/4d73ec9631b04d4289896ee1c1aeffd0/users/27214940465742d7994f77fc35d5efe4/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:35.320721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:35.322684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c96c3-7e9d-4905-ac19-919da221c787 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:35.322990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c96c3-7e9d-4905-ac19-919da221c787 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:35.323214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c96c3-7e9d-4905-ac19-919da221c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:35.328398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:35.329756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:35.332344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] PATH_INFO: `/v3/projects/9321728021b84be4a7c0f2575f5ac5e8/users/6b8498e39ff34897894c4614d7a41614/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:35.430049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9321728021b84be4a7c0f2575f5ac5e8, user_id=6b8498e39ff34897894c4614d7a41614, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:35.456925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:35.476219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-273c96c3-7e9d-4905-ac19-919da221c787 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:35.478011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-273c96c3-7e9d-4905-ac19-919da221c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:35.516861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 902/1798] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:35 2022] PUT /identity/v3/projects/9321728021b84be4a7c0f2575f5ac5e8/users/6b8498e39ff34897894c4614d7a41614/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:35.528206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:35.535019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:35.587522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:35.701810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 897/1799] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:39:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:35.702800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c96c3-7e9d-4905-ac19-919da221c787 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:35.845281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7107fd-6b8e-4e4e-a014-9c5758dda4ec admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:35.865491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3003ac9-7639-4f8c-8d28-ba7df16cdbe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:35.866638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003ac9-7639-4f8c-8d28-ba7df16cdbe7 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:35.867794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003ac9-7639-4f8c-8d28-ba7df16cdbe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:35.868706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3003ac9-7639-4f8c-8d28-ba7df16cdbe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:35.959316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c96c3-7e9d-4905-ac19-919da221c787 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:36.065104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3003ac9-7639-4f8c-8d28-ba7df16cdbe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:36.066724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3003ac9-7639-4f8c-8d28-ba7df16cdbe7 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:36.103342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 903/1800] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:36.107500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee246-b7cd-4c7e-9ea4-c14a31881ab5 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:36.107795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee246-b7cd-4c7e-9ea4-c14a31881ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:36.108080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee246-b7cd-4c7e-9ea4-c14a31881ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:36.196105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:36.196901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:36.197186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:36.197487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:36.203552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:36.208627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:36.211158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-90cee246-b7cd-4c7e-9ea4-c14a31881ab5 None None] MFA Rules not processed for user `6b8498e39ff34897894c4614d7a41614`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:36.214276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-90cee246-b7cd-4c7e-9ea4-c14a31881ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:36.255815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 898/1801] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:36.264705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:36.269027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:36.276960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:36.490541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 904/1802] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:36.493750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee246-b7cd-4c7e-9ea4-c14a31881ab5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:36.543725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee246-b7cd-4c7e-9ea4-c14a31881ab5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:36.571870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:36.573715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:36.575855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:36.577775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] PATH_INFO: `/v3/users/b32a0bbf2cc4407c9e7feda9a3f188d6` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:36.579574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32a0bbf2cc4407c9e7feda9a3f188d6)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:36.585281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:36.675814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc57b85-7e2a-4fb8-a01f-68ac8b8b78ea admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:36.697725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97578bc-fc8c-4d46-b4a7-72ed94372993 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:36.698569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97578bc-fc8c-4d46-b4a7-72ed94372993 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:36.698826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97578bc-fc8c-4d46-b4a7-72ed94372993 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:36.699134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97578bc-fc8c-4d46-b4a7-72ed94372993 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:36.715275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:36.821828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32a0bbf2cc4407c9e7feda9a3f188d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:36.841420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32a0bbf2cc4407c9e7feda9a3f188d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:36.845047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32a0bbf2cc4407c9e7feda9a3f188d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:36.845799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32a0bbf2cc4407c9e7feda9a3f188d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:36.861676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32a0bbf2cc4407c9e7feda9a3f188d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:36.917916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 905/1803] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:36 2022] DELETE /identity/v3/users/b32a0bbf2cc4407c9e7feda9a3f188d6 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:36.917916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:36.918186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97578bc-fc8c-4d46-b4a7-72ed94372993 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:36.918306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:36.918854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97578bc-fc8c-4d46-b4a7-72ed94372993 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:36.958941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 899/1804] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:39:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:39:36.960598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97578bc-fc8c-4d46-b4a7-72ed94372993 service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:36.977258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97578bc-fc8c-4d46-b4a7-72ed94372993 service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:37.173638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3325c1-678d-47e2-90c9-2d1e2b1e5f83 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:37.185766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4d497-c40b-42d7-b674-1ccb8528cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:37.201803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d497-c40b-42d7-b674-1ccb8528cc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:37.203723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d497-c40b-42d7-b674-1ccb8528cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:37.208830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d497-c40b-42d7-b674-1ccb8528cc6f admin admin] PATH_INFO: `/v3/projects/4d73ec9631b04d4289896ee1c1aeffd0/users/27214940465742d7994f77fc35d5efe4/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:37.215354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e897e52-1506-4a99-b72f-d31c7e8d17aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:37.219341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4d497-c40b-42d7-b674-1ccb8528cc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d73ec9631b04d4289896ee1c1aeffd0, user_id=27214940465742d7994f77fc35d5efe4, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:37.220496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e897e52-1506-4a99-b72f-d31c7e8d17aa service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:37.220896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e897e52-1506-4a99-b72f-d31c7e8d17aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:37.221172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e897e52-1506-4a99-b72f-d31c7e8d17aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:37.231172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4d497-c40b-42d7-b674-1ccb8528cc6f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:37.236229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7e897e52-1506-4a99-b72f-d31c7e8d17aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:37.294948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 906/1805] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:36 2022] PUT /identity/v3/projects/4d73ec9631b04d4289896ee1c1aeffd0/users/27214940465742d7994f77fc35d5efe4/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:37.294948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4948158-f465-47c6-bd40-2ca9983d1441 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:37.295908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4948158-f465-47c6-bd40-2ca9983d1441 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:37.295908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4948158-f465-47c6-bd40-2ca9983d1441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:37.412338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a4948158-f465-47c6-bd40-2ca9983d1441 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:37.416710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a4948158-f465-47c6-bd40-2ca9983d1441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:37.488560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:37.694687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e897e52-1506-4a99-b72f-d31c7e8d17aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:37.696188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e897e52-1506-4a99-b72f-d31c7e8d17aa service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:37.702052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 907/1806] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:37.703519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dde714-aef7-4656-a893-d45ba36fbbcc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:37.708584 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dde714-aef7-4656-a893-d45ba36fbbcc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:37.709224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dde714-aef7-4656-a893-d45ba36fbbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:37.764997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 900/1807] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:37.771495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d7dc0-9162-429b-9b2b-f868d9165d02 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:37.771495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d7dc0-9162-429b-9b2b-f868d9165d02 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:37.771807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d7dc0-9162-429b-9b2b-f868d9165d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:37.838593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-40dde714-aef7-4656-a893-d45ba36fbbcc None None] MFA Rules not processed for user `27214940465742d7994f77fc35d5efe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:37.844702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-40dde714-aef7-4656-a893-d45ba36fbbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:37.907461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f29d7dc0-9162-429b-9b2b-f868d9165d02 None None] MFA Rules not processed for user `323b7d02f817475791098f32bf1c953e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:37.908848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f29d7dc0-9162-429b-9b2b-f868d9165d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:38.107465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 901/1808] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Oct 3 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:38.109944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d7dc0-9162-429b-9b2b-f868d9165d02 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:38.113097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f29d7dc0-9162-429b-9b2b-f868d9165d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:38.127753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d7dc0-9162-429b-9b2b-f868d9165d02 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:38.144145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:38.145307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:38.145307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:38.146819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:38.179623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 908/1809] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:38.183259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:38.188372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:38.209475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:38.240766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 902/1810] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:38.369310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dde714-aef7-4656-a893-d45ba36fbbcc None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:38.371018 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-40dde714-aef7-4656-a893-d45ba36fbbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:38.451679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:38.453339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:38.481488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586c5c1-9876-4783-a4b9-304a23e1e6fe service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:38.516191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a0408-cf07-464e-8e3d-69e32b8dd3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:38.516837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a0408-cf07-464e-8e3d-69e32b8dd3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:38.517127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a0408-cf07-464e-8e3d-69e32b8dd3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:38.517438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a0408-cf07-464e-8e3d-69e32b8dd3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:38.561989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a0408-cf07-464e-8e3d-69e32b8dd3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:38.564533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dde714-aef7-4656-a893-d45ba36fbbcc None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:38.571842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a0408-cf07-464e-8e3d-69e32b8dd3b5 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:38.575027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4df9b-2e5e-48c8-a994-e59a59f2c1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:38.575841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4df9b-2e5e-48c8-a994-e59a59f2c1aa service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:38.576903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4df9b-2e5e-48c8-a994-e59a59f2c1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:38.577423 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4df9b-2e5e-48c8-a994-e59a59f2c1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:38.596564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 903/1811] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:39:38.618581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4df9b-2e5e-48c8-a994-e59a59f2c1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:38.632461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4df9b-2e5e-48c8-a994-e59a59f2c1aa service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:38.672774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 909/1812] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:39.735019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a0408-cf07-464e-8e3d-69e32b8dd3b5 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:39.754934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a0408-cf07-464e-8e3d-69e32b8dd3b5 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:39.769167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:39.770340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:39.770862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:39.771375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] PATH_INFO: `/v3/users/a1d7e021f532488091fe68d2bdf35b98` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:39.772992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d7e021f532488091fe68d2bdf35b98)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:39.775624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:39.846670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d7e021f532488091fe68d2bdf35b98'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:39.847954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d7e021f532488091fe68d2bdf35b98'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:39.861286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d7e021f532488091fe68d2bdf35b98'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:39.862594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d7e021f532488091fe68d2bdf35b98'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:39.874840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d7e021f532488091fe68d2bdf35b98'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:39.910083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128595bc-1655-4094-a959-4add5aeea480 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:39.911360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128595bc-1655-4094-a959-4add5aeea480 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:39.911857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128595bc-1655-4094-a959-4add5aeea480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:39.915407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 904/1813] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:39 2022] DELETE /identity/v3/users/a1d7e021f532488091fe68d2bdf35b98 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:39.940611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-128595bc-1655-4094-a959-4add5aeea480 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:39.942410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-128595bc-1655-4094-a959-4add5aeea480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:40.071656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:40.145159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 910/1814] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:40.573142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:40.575738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:40.751622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622c536-9aac-4e2a-aeb7-3642459a4c9b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:40.759190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:40.761106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:40.761733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:40.762174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:40.782079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:40.784230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:40.798579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 905/1815] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:43.453576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128595bc-1655-4094-a959-4add5aeea480 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:43.453576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-128595bc-1655-4094-a959-4add5aeea480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:43.479749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128595bc-1655-4094-a959-4add5aeea480 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:43.493680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:43.495249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:43.497052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:43.498014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] PATH_INFO: `/v3/projects/32fb66e344ef4706ab2971dc01cf5b39` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:43.501654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fb66e344ef4706ab2971dc01cf5b39)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:43.505848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:43.664486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fb66e344ef4706ab2971dc01cf5b39', 'request_id': 'req-46b55cd6-32b9-4d68-bec2-9a7d86477b95'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:43.680154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fb66e344ef4706ab2971dc01cf5b39', 'request_id': 'req-46b55cd6-32b9-4d68-bec2-9a7d86477b95'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:43.684315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:43.686295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:43.714310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71b510-198e-480e-bcee-b1cf9a1f2af3 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:43.724060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fb66e344ef4706ab2971dc01cf5b39', 'request_id': 'req-46b55cd6-32b9-4d68-bec2-9a7d86477b95'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:43.748708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] The token cache is being invalidate because project 32fb66e344ef4706ab2971dc01cf5b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:43.749627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:43.751775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:43.760679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 911/1816] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:43 2022] DELETE /identity/v3/projects/32fb66e344ef4706ab2971dc01cf5b39 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:43.765694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:43.769680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:43.951303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b55cd6-32b9-4d68-bec2-9a7d86477b95 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:43.970428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:43.971174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:43.971428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:43.971748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] PATH_INFO: `/v3/projects/373c34e60db140e3af4d2a1440326a6b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:43.974381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=373c34e60db140e3af4d2a1440326a6b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:43.977271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:43.978400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:43.979396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:43.979744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:43.980099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:43.980562 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] PATH_INFO: `/v3/users/27214940465742d7994f77fc35d5efe4` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:43.985170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=27214940465742d7994f77fc35d5efe4)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:43.988012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:44.147075 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27214940465742d7994f77fc35d5efe4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.165181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373c34e60db140e3af4d2a1440326a6b', 'request_id': 'req-56dea4ca-4f72-46ca-899a-734f2744b33e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.166312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27214940465742d7994f77fc35d5efe4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.167549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27214940465742d7994f77fc35d5efe4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.168492 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27214940465742d7994f77fc35d5efe4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.186618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27214940465742d7994f77fc35d5efe4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.210201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373c34e60db140e3af4d2a1440326a6b', 'request_id': 'req-56dea4ca-4f72-46ca-899a-734f2744b33e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.216797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:44.230989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 912/1817] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:43 2022] DELETE /identity/v3/users/27214940465742d7994f77fc35d5efe4 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:44.244868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373c34e60db140e3af4d2a1440326a6b', 'request_id': 'req-56dea4ca-4f72-46ca-899a-734f2744b33e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.302519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] The token cache is being invalidate because project 373c34e60db140e3af4d2a1440326a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:44.302858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.303996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-56dea4ca-4f72-46ca-899a-734f2744b33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.307184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 906/1818] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:43 2022] DELETE /identity/v3/projects/373c34e60db140e3af4d2a1440326a6b => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:44.324452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:44.329583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:44.556756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6016-11ae-44bd-aaaa-3833903c03eb None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:44.558673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6016-11ae-44bd-aaaa-3833903c03eb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:44.560252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e6016-11ae-44bd-aaaa-3833903c03eb None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:44.566844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 907/1819] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:39:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:39:44.583977 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cef029-46d3-4d13-a69c-d2ba74b21dbc admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:44.589338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d5db4-9d4f-4a19-b9ca-b4bef48da582 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:44.589928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d5db4-9d4f-4a19-b9ca-b4bef48da582 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:44.590428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d5db4-9d4f-4a19-b9ca-b4bef48da582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:44.608504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:44.619004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:44.620502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:44.621209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] PATH_INFO: `/v3/users/45ca8d2dab6c462cb75f4224cac8fb46` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:44.625063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ca8d2dab6c462cb75f4224cac8fb46)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:44.650937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:44.678879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ce8d5db4-9d4f-4a19-b9ca-b4bef48da582 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:44.683294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ce8d5db4-9d4f-4a19-b9ca-b4bef48da582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:44.877782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ca8d2dab6c462cb75f4224cac8fb46'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.908569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ca8d2dab6c462cb75f4224cac8fb46'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.909649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ca8d2dab6c462cb75f4224cac8fb46'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.910704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ca8d2dab6c462cb75f4224cac8fb46'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.934879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ca8d2dab6c462cb75f4224cac8fb46'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:44.979873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 913/1820] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:44 2022] DELETE /identity/v3/users/45ca8d2dab6c462cb75f4224cac8fb46 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:45.042218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 908/1821] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:45.847114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:45.848737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:45.933221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d5db4-9d4f-4a19-b9ca-b4bef48da582 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:45.936148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ce8d5db4-9d4f-4a19-b9ca-b4bef48da582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:45.958311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d5db4-9d4f-4a19-b9ca-b4bef48da582 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:46.077537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec4279-29ef-4b4e-ae09-4d0089afd7a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:46.079124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec4279-29ef-4b4e-ae09-4d0089afd7a1 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:46.079813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec4279-29ef-4b4e-ae09-4d0089afd7a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:46.080484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec4279-29ef-4b4e-ae09-4d0089afd7a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:46.097208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec4279-29ef-4b4e-ae09-4d0089afd7a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:46.099420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec4279-29ef-4b4e-ae09-4d0089afd7a1 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:46.116117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 909/1822] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:46.131742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14978314-9fd6-4125-9109-88043c300db1 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:46.147679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:46.149207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:46.149754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:46.150332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] PATH_INFO: `/v3/users/6b8498e39ff34897894c4614d7a41614` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:46.154483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8498e39ff34897894c4614d7a41614)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:46.160189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:46.212657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:46.310245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8498e39ff34897894c4614d7a41614'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:46.326913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8498e39ff34897894c4614d7a41614'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:46.330242 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8498e39ff34897894c4614d7a41614'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:46.331908 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8498e39ff34897894c4614d7a41614'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:46.361947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8498e39ff34897894c4614d7a41614'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:46.414420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 914/1823] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:45 2022] DELETE /identity/v3/users/6b8498e39ff34897894c4614d7a41614 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:46.419099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2b76-66ab-478b-837a-a648bfa5074c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:46.419557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2b76-66ab-478b-837a-a648bfa5074c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:46.420072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb2b76-66ab-478b-837a-a648bfa5074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:46.440832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:46.455676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-25bb2b76-66ab-478b-837a-a648bfa5074c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:46.457873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-25bb2b76-66ab-478b-837a-a648bfa5074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:46.634480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 910/1824] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:46.777073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:46.780182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:46.972839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb2b76-66ab-478b-837a-a648bfa5074c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:46.974498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-25bb2b76-66ab-478b-837a-a648bfa5074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:46.980816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5c6ee-bef1-42a3-b05e-25a5117d78d9 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:46.996066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb2b76-66ab-478b-837a-a648bfa5074c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:46.999639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55f47e-eb02-4a37-ad3c-129d02e3a001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:47.000497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f47e-eb02-4a37-ad3c-129d02e3a001 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.000648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f47e-eb02-4a37-ad3c-129d02e3a001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.001044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55f47e-eb02-4a37-ad3c-129d02e3a001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.011332 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:47.012077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.012566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.012881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] PATH_INFO: `/v3/projects/4d73ec9631b04d4289896ee1c1aeffd0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.014255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d73ec9631b04d4289896ee1c1aeffd0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:47.016371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:47.023978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55f47e-eb02-4a37-ad3c-129d02e3a001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:47.026214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55f47e-eb02-4a37-ad3c-129d02e3a001 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:47.044678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 915/1825] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:47.116275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d73ec9631b04d4289896ee1c1aeffd0', 'request_id': 'req-8a80f550-b985-405a-85f7-b13bc59ae763'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:47.128516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c017a4-eff0-4e7a-8379-8fff7ac39ae1 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.128927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c017a4-eff0-4e7a-8379-8fff7ac39ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.129174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c017a4-eff0-4e7a-8379-8fff7ac39ae1 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.129693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d73ec9631b04d4289896ee1c1aeffd0', 'request_id': 'req-8a80f550-b985-405a-85f7-b13bc59ae763'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:47.130779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 916/1826] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:39:47.141736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d73ec9631b04d4289896ee1c1aeffd0', 'request_id': 'req-8a80f550-b985-405a-85f7-b13bc59ae763'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:47.158711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e6c5-6e32-4d34-96b3-bf1a3f18a2c0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.158978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e6c5-6e32-4d34-96b3-bf1a3f18a2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.159077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] The token cache is being invalidate because project 4d73ec9631b04d4289896ee1c1aeffd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:47.159310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e6c5-6e32-4d34-96b3-bf1a3f18a2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.160006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:47.177727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a80f550-b985-405a-85f7-b13bc59ae763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:47.185976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 911/1827] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:46 2022] DELETE /identity/v3/projects/4d73ec9631b04d4289896ee1c1aeffd0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:47.187984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7562fa-bbab-4688-80eb-9dfcdc501008 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.188322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7562fa-bbab-4688-80eb-9dfcdc501008 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.188649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7562fa-bbab-4688-80eb-9dfcdc501008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.213891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2707e6c5-6e32-4d34-96b3-bf1a3f18a2c0 None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:47.215320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2707e6c5-6e32-4d34-96b3-bf1a3f18a2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:47.236225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7c7562fa-bbab-4688-80eb-9dfcdc501008 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:47.240508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7c7562fa-bbab-4688-80eb-9dfcdc501008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:47.374665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 912/1828] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:47.382358 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135bcb-240e-482e-a675-57110c422539 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.382961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135bcb-240e-482e-a675-57110c422539 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.384209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135bcb-240e-482e-a675-57110c422539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.419488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-63135bcb-240e-482e-a675-57110c422539 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:47.420933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-63135bcb-240e-482e-a675-57110c422539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:47.439013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 913/1829] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:47.440170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63135bcb-240e-482e-a675-57110c422539 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:47.455147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63135bcb-240e-482e-a675-57110c422539 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:47.470073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:47.471104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.471520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.471926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.472995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:47.473438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:47.481636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:47.488887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 917/1830] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:47.535857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707e6c5-6e32-4d34-96b3-bf1a3f18a2c0 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:47.538070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 914/1831] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:47.554974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707e6c5-6e32-4d34-96b3-bf1a3f18a2c0 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:47.567185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc1e84-a732-4003-a88a-5f9f07349e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:47.567840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc1e84-a732-4003-a88a-5f9f07349e6f admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.568128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc1e84-a732-4003-a88a-5f9f07349e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.568412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc1e84-a732-4003-a88a-5f9f07349e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.572296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc1e84-a732-4003-a88a-5f9f07349e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:47.574530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc1e84-a732-4003-a88a-5f9f07349e6f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:47.651142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 918/1832] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:47 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:39:47.655575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:47.673578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d235e-00ab-48d3-ada7-41da5a7ede15 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:47.689104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:47.838407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce537a-19d6-4bbd-a42b-8153f2b7a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:47.839086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce537a-19d6-4bbd-a42b-8153f2b7a92a admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.839337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce537a-19d6-4bbd-a42b-8153f2b7a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.839640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce537a-19d6-4bbd-a42b-8153f2b7a92a admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.840452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce537a-19d6-4bbd-a42b-8153f2b7a92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:47.842468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce537a-19d6-4bbd-a42b-8153f2b7a92a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:47.891208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 915/1833] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:47 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:47.892439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc1e84-a732-4003-a88a-5f9f07349e6f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:47.907760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:47.913248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc1e84-a732-4003-a88a-5f9f07349e6f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:47.927847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7535c-3346-4f3f-9375-aa6c3dbf7097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:47.928516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7535c-3346-4f3f-9375-aa6c3dbf7097 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:47.928997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7535c-3346-4f3f-9375-aa6c3dbf7097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:47.929344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7535c-3346-4f3f-9375-aa6c3dbf7097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:47.930041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7535c-3346-4f3f-9375-aa6c3dbf7097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:47.940547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7535c-3346-4f3f-9375-aa6c3dbf7097 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:47.974710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 919/1834] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:47.976970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce537a-19d6-4bbd-a42b-8153f2b7a92a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:47.993798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce537a-19d6-4bbd-a42b-8153f2b7a92a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:48.015642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da8eec-bd62-4407-906d-6fc185263175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:48.016288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8eec-bd62-4407-906d-6fc185263175 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:48.016589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8eec-bd62-4407-906d-6fc185263175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:48.016867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8eec-bd62-4407-906d-6fc185263175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:48.017546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8eec-bd62-4407-906d-6fc185263175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:48.019362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8eec-bd62-4407-906d-6fc185263175 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:48.045389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 916/1835] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:48.045476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7535c-3346-4f3f-9375-aa6c3dbf7097 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:48.065803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7535c-3346-4f3f-9375-aa6c3dbf7097 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:48.075744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0ecdf-853b-4f63-bcf9-9fd570900132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:48.076464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ecdf-853b-4f63-bcf9-9fd570900132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:48.076812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ecdf-853b-4f63-bcf9-9fd570900132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:48.077200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ecdf-853b-4f63-bcf9-9fd570900132 admin admin] PATH_INFO: `/v3/projects/04ad17fdbe8a4326a57aba9675f224d1/users/f2f0113f777f4757821f978999ba1c53/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:48.121327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0ecdf-853b-4f63-bcf9-9fd570900132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ad17fdbe8a4326a57aba9675f224d1, user_id=f2f0113f777f4757821f978999ba1c53, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:48.124246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0ecdf-853b-4f63-bcf9-9fd570900132 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:48.156592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 920/1836] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:48 2022] PUT /identity/v3/projects/04ad17fdbe8a4326a57aba9675f224d1/users/f2f0113f777f4757821f978999ba1c53/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:48.179738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004e8b4-7c1c-48c4-8b44-c32381af4eb3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:48.180309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004e8b4-7c1c-48c4-8b44-c32381af4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:48.181116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004e8b4-7c1c-48c4-8b44-c32381af4eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:48.251884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6004e8b4-7c1c-48c4-8b44-c32381af4eb3 None None] MFA Rules not processed for user `f2f0113f777f4757821f978999ba1c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:48.253333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6004e8b4-7c1c-48c4-8b44-c32381af4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:48.403107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 917/1837] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:48.409925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0ecdf-853b-4f63-bcf9-9fd570900132 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:48.529567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004e8b4-7c1c-48c4-8b44-c32381af4eb3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:48.531092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6004e8b4-7c1c-48c4-8b44-c32381af4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:48.561153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0ecdf-853b-4f63-bcf9-9fd570900132 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:48.582494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:48.583629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:48.585509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:48.588360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:48.589054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:48.593705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:48.730808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 921/1838] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:48 2022] POST /identity/v3/projects => generated 383 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:48.731696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:48.734737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:48.781923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004e8b4-7c1c-48c4-8b44-c32381af4eb3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:48.810413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:48.945979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6059f8-dfbc-44df-9c33-39111fe9befa admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:48.959305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:48.962640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:48.962956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:48.963378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] PATH_INFO: `/v3/projects/4ffd21ec4bcd43339724ca0ebba7a8a1` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:48.964878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffd21ec4bcd43339724ca0ebba7a8a1)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:48.969458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb5bb9-f507-42fc-a159-c5b4f61d91d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:48.970192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb5bb9-f507-42fc-a159-c5b4f61d91d4 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:48.971097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb5bb9-f507-42fc-a159-c5b4f61d91d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:48.971097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb5bb9-f507-42fc-a159-c5b4f61d91d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:48.973458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.004118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb5bb9-f507-42fc-a159-c5b4f61d91d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.005959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb5bb9-f507-42fc-a159-c5b4f61d91d4 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.036088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 918/1839] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:49.037005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb5bb9-f507-42fc-a159-c5b4f61d91d4 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.068821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb5bb9-f507-42fc-a159-c5b4f61d91d4 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.119008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffd21ec4bcd43339724ca0ebba7a8a1', 'request_id': 'req-af701d9c-9a64-4a21-a3e0-344973b7941a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.134445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffd21ec4bcd43339724ca0ebba7a8a1', 'request_id': 'req-af701d9c-9a64-4a21-a3e0-344973b7941a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.136225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:49.146803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffd21ec4bcd43339724ca0ebba7a8a1', 'request_id': 'req-af701d9c-9a64-4a21-a3e0-344973b7941a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.174530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] The token cache is being invalidate because project 4ffd21ec4bcd43339724ca0ebba7a8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:49.174876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.175630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-af701d9c-9a64-4a21-a3e0-344973b7941a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.177267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 922/1840] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:48 2022] DELETE /identity/v3/projects/4ffd21ec4bcd43339724ca0ebba7a8a1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:49.182813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e3996-68e2-4a54-a6e1-b0811a63e26b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.183195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e3996-68e2-4a54-a6e1-b0811a63e26b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.183477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e3996-68e2-4a54-a6e1-b0811a63e26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.248644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-720e3996-68e2-4a54-a6e1-b0811a63e26b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:49.250826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-720e3996-68e2-4a54-a6e1-b0811a63e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.266179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f98a41-0366-4370-b6d5-bcffd0122713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.267468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98a41-0366-4370-b6d5-bcffd0122713 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.267911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98a41-0366-4370-b6d5-bcffd0122713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.268345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f98a41-0366-4370-b6d5-bcffd0122713 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.269147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98a41-0366-4370-b6d5-bcffd0122713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.271759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f98a41-0366-4370-b6d5-bcffd0122713 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.278597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 923/1841] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:49.279836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e3996-68e2-4a54-a6e1-b0811a63e26b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.283404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-720e3996-68e2-4a54-a6e1-b0811a63e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.312677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e3996-68e2-4a54-a6e1-b0811a63e26b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.314253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 919/1842] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:49.315713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bfa72-fd9e-4b98-a617-efd5dae0e2fa None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.316011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bfa72-fd9e-4b98-a617-efd5dae0e2fa None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.316540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bfa72-fd9e-4b98-a617-efd5dae0e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.331754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.332443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.332726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.333005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] PATH_INFO: `/v3/projects/9321728021b84be4a7c0f2575f5ac5e8` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.336937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9321728021b84be4a7c0f2575f5ac5e8)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.339082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.344995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-947bfa72-fd9e-4b98-a617-efd5dae0e2fa None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:49.346381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-947bfa72-fd9e-4b98-a617-efd5dae0e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.355416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 920/1843] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:49.360027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bfa72-fd9e-4b98-a617-efd5dae0e2fa None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.363313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-947bfa72-fd9e-4b98-a617-efd5dae0e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.377107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bfa72-fd9e-4b98-a617-efd5dae0e2fa None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.383286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8e52b-2b0f-4985-8697-99f390ba26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.384958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e52b-2b0f-4985-8697-99f390ba26f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.384958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e52b-2b0f-4985-8697-99f390ba26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.385271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e52b-2b0f-4985-8697-99f390ba26f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.385956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8e52b-2b0f-4985-8697-99f390ba26f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.387674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8e52b-2b0f-4985-8697-99f390ba26f2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.399191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 921/1844] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:49.400292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8e52b-2b0f-4985-8697-99f390ba26f2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.405157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9321728021b84be4a7c0f2575f5ac5e8', 'request_id': 'req-29cf84d8-2603-4293-b718-0c5fd31e2cd0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.410766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8e52b-2b0f-4985-8697-99f390ba26f2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.416948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9321728021b84be4a7c0f2575f5ac5e8', 'request_id': 'req-29cf84d8-2603-4293-b718-0c5fd31e2cd0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.424319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9321728021b84be4a7c0f2575f5ac5e8', 'request_id': 'req-29cf84d8-2603-4293-b718-0c5fd31e2cd0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.442321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] The token cache is being invalidate because project 9321728021b84be4a7c0f2575f5ac5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:49.442917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.443678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:49.445796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 924/1845] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:49 2022] DELETE /identity/v3/projects/9321728021b84be4a7c0f2575f5ac5e8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:49.447191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.448634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.485413 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef63e2e-4551-46d1-9adc-126304e5519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.486076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63e2e-4551-46d1-9adc-126304e5519e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.486830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63e2e-4551-46d1-9adc-126304e5519e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.486830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef63e2e-4551-46d1-9adc-126304e5519e admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.487277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63e2e-4551-46d1-9adc-126304e5519e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:49.487594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63e2e-4551-46d1-9adc-126304e5519e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.489250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef63e2e-4551-46d1-9adc-126304e5519e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.503591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 922/1846] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:49.506190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3470-2362-4653-9e19-2a1f7710e47b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.506658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3470-2362-4653-9e19-2a1f7710e47b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.507338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b3470-2362-4653-9e19-2a1f7710e47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.528872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f53b3470-2362-4653-9e19-2a1f7710e47b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:49.530148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f53b3470-2362-4653-9e19-2a1f7710e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.535132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf84d8-2603-4293-b718-0c5fd31e2cd0 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.540404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 923/1847] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:49.541347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b3470-2362-4653-9e19-2a1f7710e47b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.541574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2751f15-a37a-4030-95e4-14b6044cd5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.542215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2751f15-a37a-4030-95e4-14b6044cd5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.542497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2751f15-a37a-4030-95e4-14b6044cd5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.542776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2751f15-a37a-4030-95e4-14b6044cd5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.544691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2751f15-a37a-4030-95e4-14b6044cd5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.545901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f53b3470-2362-4653-9e19-2a1f7710e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.550329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2751f15-a37a-4030-95e4-14b6044cd5e2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.554016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:49.561798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b3470-2362-4653-9e19-2a1f7710e47b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.567289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 925/1848] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:49.567289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a495-d560-40b8-885e-266c7e066049 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.567289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a495-d560-40b8-885e-266c7e066049 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.567289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374a495-d560-40b8-885e-266c7e066049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.572389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79a2a-618d-4d11-9742-4db0d565eae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.573286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79a2a-618d-4d11-9742-4db0d565eae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.573744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79a2a-618d-4d11-9742-4db0d565eae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.574126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79a2a-618d-4d11-9742-4db0d565eae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.575726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79a2a-618d-4d11-9742-4db0d565eae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.578084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79a2a-618d-4d11-9742-4db0d565eae2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.603032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a374a495-d560-40b8-885e-266c7e066049 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:49.604735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a374a495-d560-40b8-885e-266c7e066049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.613001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 924/1849] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:49.614256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79a2a-618d-4d11-9742-4db0d565eae2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.616652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 926/1850] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:49.617582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374a495-d560-40b8-885e-266c7e066049 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.627375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374a495-d560-40b8-885e-266c7e066049 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.678635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:49.690466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79a2a-618d-4d11-9742-4db0d565eae2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.696566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b8ba5-3565-4f22-943f-a4142e6a9e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.697177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8ba5-3565-4f22-943f-a4142e6a9e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.697555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8ba5-3565-4f22-943f-a4142e6a9e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.697795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b8ba5-3565-4f22-943f-a4142e6a9e49 admin admin] PATH_INFO: `/v3/projects/d52b18a293ae4ec49d0d76488c4df1a3/users/9df4994170274a1293946fda22ae93ab/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.708632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.709881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.710282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.711812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.712589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:49.713021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.716111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.728209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b8ba5-3565-4f22-943f-a4142e6a9e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b18a293ae4ec49d0d76488c4df1a3, user_id=9df4994170274a1293946fda22ae93ab, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.731105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b8ba5-3565-4f22-943f-a4142e6a9e49 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.739256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 927/1851] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:49.740222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.761171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 925/1852] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:49 2022] PUT /identity/v3/projects/d52b18a293ae4ec49d0d76488c4df1a3/users/9df4994170274a1293946fda22ae93ab/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:49.761171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b8ba5-3565-4f22-943f-a4142e6a9e49 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.765854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb383139-113d-4530-98bc-09996e77d163 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.830828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81d4db-019a-4498-a2a8-1e9d1e0bb78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.831456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d4db-019a-4498-a2a8-1e9d1e0bb78d admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.831739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d4db-019a-4498-a2a8-1e9d1e0bb78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.832016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81d4db-019a-4498-a2a8-1e9d1e0bb78d admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.832650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d4db-019a-4498-a2a8-1e9d1e0bb78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.834416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b8ba5-3565-4f22-943f-a4142e6a9e49 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.834618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81d4db-019a-4498-a2a8-1e9d1e0bb78d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.839403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea220a-0cca-4d01-b636-76e89fa2d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.840444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea220a-0cca-4d01-b636-76e89fa2d104 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.840444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea220a-0cca-4d01-b636-76e89fa2d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.840769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea220a-0cca-4d01-b636-76e89fa2d104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.841468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea220a-0cca-4d01-b636-76e89fa2d104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.843482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea220a-0cca-4d01-b636-76e89fa2d104 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.860284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 928/1853] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:49.861549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7a6f7-df67-4028-bffe-22aa0a910fc9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.861963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7a6f7-df67-4028-bffe-22aa0a910fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.862250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7a6f7-df67-4028-bffe-22aa0a910fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.884440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 926/1854] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:49.885391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea220a-0cca-4d01-b636-76e89fa2d104 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:49.899005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-9aa7a6f7-df67-4028-bffe-22aa0a910fc9 None None] MFA Rules not processed for user `9df4994170274a1293946fda22ae93ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:49.900474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9aa7a6f7-df67-4028-bffe-22aa0a910fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:49.944981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:49.971154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea220a-0cca-4d01-b636-76e89fa2d104 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:49.977079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504d59d-e778-4595-88fe-75c7ed5374c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:49.978312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504d59d-e778-4595-88fe-75c7ed5374c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:49.978715 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504d59d-e778-4595-88fe-75c7ed5374c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:49.979057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504d59d-e778-4595-88fe-75c7ed5374c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:49.979789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504d59d-e778-4595-88fe-75c7ed5374c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:49.981427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504d59d-e778-4595-88fe-75c7ed5374c9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:49.995006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 927/1855] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:49.996142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504d59d-e778-4595-88fe-75c7ed5374c9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.006746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504d59d-e778-4595-88fe-75c7ed5374c9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.008254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 929/1856] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:50.010384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7a6f7-df67-4028-bffe-22aa0a910fc9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.016008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37b97e-209c-4bfc-bc13-4fe420b33106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.016885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37b97e-209c-4bfc-bc13-4fe420b33106 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.017180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37b97e-209c-4bfc-bc13-4fe420b33106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.017463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37b97e-209c-4bfc-bc13-4fe420b33106 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.018840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37b97e-209c-4bfc-bc13-4fe420b33106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.020842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37b97e-209c-4bfc-bc13-4fe420b33106 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.022255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7a6f7-df67-4028-bffe-22aa0a910fc9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.027488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91798-c8b9-4451-ab3f-3a2d7215db10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.028103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91798-c8b9-4451-ab3f-3a2d7215db10 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.028385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91798-c8b9-4451-ab3f-3a2d7215db10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.028660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f91798-c8b9-4451-ab3f-3a2d7215db10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.029429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f91798-c8b9-4451-ab3f-3a2d7215db10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.030960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f91798-c8b9-4451-ab3f-3a2d7215db10 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.047074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 930/1857] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:50.047074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91798-c8b9-4451-ab3f-3a2d7215db10 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.047226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 928/1858] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:49 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:50.048435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37b97e-209c-4bfc-bc13-4fe420b33106 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.059356 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f91798-c8b9-4451-ab3f-3a2d7215db10 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.061614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37b97e-209c-4bfc-bc13-4fe420b33106 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.064357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d07b3-c502-486a-a40c-d45d8fcea368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.065035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d07b3-c502-486a-a40c-d45d8fcea368 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.065494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d07b3-c502-486a-a40c-d45d8fcea368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.065804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d07b3-c502-486a-a40c-d45d8fcea368 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.066562 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d07b3-c502-486a-a40c-d45d8fcea368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.066868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2747-41c6-4451-80aa-41c25dca6423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.067542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2747-41c6-4451-80aa-41c25dca6423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.067830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2747-41c6-4451-80aa-41c25dca6423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.068111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2747-41c6-4451-80aa-41c25dca6423 admin admin] PATH_INFO: `/v3/projects/8f566edd18f0406fbaa86d538b20c120/users/02aad06d19a54bb9b34efd0ac4c1c4d1/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.068884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d07b3-c502-486a-a40c-d45d8fcea368 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.085048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2747-41c6-4451-80aa-41c25dca6423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f566edd18f0406fbaa86d538b20c120, user_id=02aad06d19a54bb9b34efd0ac4c1c4d1, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.088703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2747-41c6-4451-80aa-41c25dca6423 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.103911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 929/1859] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:50 2022] PUT /identity/v3/projects/8f566edd18f0406fbaa86d538b20c120/users/02aad06d19a54bb9b34efd0ac4c1c4d1/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:50.104815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2747-41c6-4451-80aa-41c25dca6423 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.115428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 931/1860] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:50.116642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f365b5-0bfa-4ec3-a4e9-c532f31f502c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.116947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f365b5-0bfa-4ec3-a4e9-c532f31f502c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.117211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f365b5-0bfa-4ec3-a4e9-c532f31f502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.146663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b8f365b5-0bfa-4ec3-a4e9-c532f31f502c None None] MFA Rules not processed for user `02aad06d19a54bb9b34efd0ac4c1c4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:50.147895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b8f365b5-0bfa-4ec3-a4e9-c532f31f502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:50.167518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:50.177180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2747-41c6-4451-80aa-41c25dca6423 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.215390 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 932/1861] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:50.219080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f365b5-0bfa-4ec3-a4e9-c532f31f502c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.236497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025589a0-f6cb-47b7-848b-fb2706175477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.237112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025589a0-f6cb-47b7-848b-fb2706175477 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.237393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025589a0-f6cb-47b7-848b-fb2706175477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.237697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025589a0-f6cb-47b7-848b-fb2706175477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.238335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025589a0-f6cb-47b7-848b-fb2706175477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.240204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025589a0-f6cb-47b7-848b-fb2706175477 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.251013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 930/1862] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:50.251703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025589a0-f6cb-47b7-848b-fb2706175477 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.262834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025589a0-f6cb-47b7-848b-fb2706175477 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.268666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af657-bdd0-4030-b954-9d793dd460a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.269319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af657-bdd0-4030-b954-9d793dd460a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.269601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af657-bdd0-4030-b954-9d793dd460a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.269887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60af657-bdd0-4030-b954-9d793dd460a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.270587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60af657-bdd0-4030-b954-9d793dd460a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.272499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60af657-bdd0-4030-b954-9d793dd460a0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.286726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f365b5-0bfa-4ec3-a4e9-c532f31f502c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.293024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c818-ca30-4126-855e-2964766b8ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.294022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c818-ca30-4126-855e-2964766b8ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.294347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c818-ca30-4126-855e-2964766b8ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.294566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c818-ca30-4126-855e-2964766b8ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.295349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5c818-ca30-4126-855e-2964766b8ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.297306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5c818-ca30-4126-855e-2964766b8ba9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.304267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 931/1863] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:50.305168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af657-bdd0-4030-b954-9d793dd460a0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.324414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 933/1864] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:50.324414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c818-ca30-4126-855e-2964766b8ba9 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.338066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c818-ca30-4126-855e-2964766b8ba9 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.353640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:50.398055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60af657-bdd0-4030-b954-9d793dd460a0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.404233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8215-9809-4a20-85e8-87bc29d5ef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.404973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8215-9809-4a20-85e8-87bc29d5ef7e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.405402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8215-9809-4a20-85e8-87bc29d5ef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.405786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e8215-9809-4a20-85e8-87bc29d5ef7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.406444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8215-9809-4a20-85e8-87bc29d5ef7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.407333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1311410-de75-49e6-b210-0c4d1f7f4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.407950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311410-de75-49e6-b210-0c4d1f7f4604 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.408052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e8215-9809-4a20-85e8-87bc29d5ef7e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.408234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311410-de75-49e6-b210-0c4d1f7f4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.408511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311410-de75-49e6-b210-0c4d1f7f4604 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.409152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1311410-de75-49e6-b210-0c4d1f7f4604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.411305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1311410-de75-49e6-b210-0c4d1f7f4604 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.421898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 932/1865] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:50.421898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8215-9809-4a20-85e8-87bc29d5ef7e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.431999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e8215-9809-4a20-85e8-87bc29d5ef7e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.436021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 934/1866] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:50.437066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1311410-de75-49e6-b210-0c4d1f7f4604 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.439232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46e28a-b615-4685-9a41-4f38236a6284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.440010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46e28a-b615-4685-9a41-4f38236a6284 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.440363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46e28a-b615-4685-9a41-4f38236a6284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.440740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46e28a-b615-4685-9a41-4f38236a6284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.441490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46e28a-b615-4685-9a41-4f38236a6284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.443106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46e28a-b615-4685-9a41-4f38236a6284 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.448941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1311410-de75-49e6-b210-0c4d1f7f4604 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.456665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 933/1867] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:50.456808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083ea09-b6d3-4021-9021-07a0e69b57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.456808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083ea09-b6d3-4021-9021-07a0e69b57dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.457014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46e28a-b615-4685-9a41-4f38236a6284 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.457099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083ea09-b6d3-4021-9021-07a0e69b57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.457099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083ea09-b6d3-4021-9021-07a0e69b57dd admin admin] PATH_INFO: `/v3/projects/9b983005f7e64429b6d7a387e49bcdb2/users/133287e1dceb4364b15fa285ac22bf7a/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.465304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46e28a-b615-4685-9a41-4f38236a6284 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.470050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58ecee-579e-4100-914e-fa0b8e0dd571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.470588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58ecee-579e-4100-914e-fa0b8e0dd571 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.470876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58ecee-579e-4100-914e-fa0b8e0dd571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.471161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58ecee-579e-4100-914e-fa0b8e0dd571 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.471800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58ecee-579e-4100-914e-fa0b8e0dd571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.473106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083ea09-b6d3-4021-9021-07a0e69b57dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b983005f7e64429b6d7a387e49bcdb2, user_id=133287e1dceb4364b15fa285ac22bf7a, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.473441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58ecee-579e-4100-914e-fa0b8e0dd571 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.476557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083ea09-b6d3-4021-9021-07a0e69b57dd admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.486324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 934/1868] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:50.487216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58ecee-579e-4100-914e-fa0b8e0dd571 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.492116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 935/1869] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:50 2022] PUT /identity/v3/projects/9b983005f7e64429b6d7a387e49bcdb2/users/133287e1dceb4364b15fa285ac22bf7a/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:50.493640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083ea09-b6d3-4021-9021-07a0e69b57dd admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.505909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58ecee-579e-4100-914e-fa0b8e0dd571 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.518953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:50.565223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb7bcc-630a-48f4-a26d-dfa6db162850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.565926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7bcc-630a-48f4-a26d-dfa6db162850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.566211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7bcc-630a-48f4-a26d-dfa6db162850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.566487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7bcc-630a-48f4-a26d-dfa6db162850 admin admin] PATH_INFO: `/v3/projects/dd59f7e208cd4741ac78bc48f47a16bc/users/a488c1b86a114ecc9474012ca7ce22c7/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.567405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083ea09-b6d3-4021-9021-07a0e69b57dd admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.572140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00402240-abaa-400d-a5d4-f0bf62c75a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.572750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00402240-abaa-400d-a5d4-f0bf62c75a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.573031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00402240-abaa-400d-a5d4-f0bf62c75a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.573308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00402240-abaa-400d-a5d4-f0bf62c75a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.573986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00402240-abaa-400d-a5d4-f0bf62c75a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.575796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00402240-abaa-400d-a5d4-f0bf62c75a32 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.581058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb7bcc-630a-48f4-a26d-dfa6db162850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd59f7e208cd4741ac78bc48f47a16bc, user_id=a488c1b86a114ecc9474012ca7ce22c7, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.583750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb7bcc-630a-48f4-a26d-dfa6db162850 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.585860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 936/1870] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:50.587098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fe4b9-0085-4096-8607-141212217925 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.587387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fe4b9-0085-4096-8607-141212217925 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.587666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fe4b9-0085-4096-8607-141212217925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.600374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 935/1871] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:50 2022] PUT /identity/v3/projects/dd59f7e208cd4741ac78bc48f47a16bc/users/a488c1b86a114ecc9474012ca7ce22c7/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:50.601403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb7bcc-630a-48f4-a26d-dfa6db162850 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.621138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-456fe4b9-0085-4096-8607-141212217925 None None] MFA Rules not processed for user `133287e1dceb4364b15fa285ac22bf7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:50.622453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-456fe4b9-0085-4096-8607-141212217925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:50.688224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb7bcc-630a-48f4-a26d-dfa6db162850 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.697091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.697919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.698305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.698680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] PATH_INFO: `/v3/projects/ca3c9950632e43a3ae4c9618ad064b6e/users/e1282273aad3420fbc26f3d759c7346b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.706849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 937/1872] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:50.707793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fe4b9-0085-4096-8607-141212217925 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.721147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3c9950632e43a3ae4c9618ad064b6e, user_id=e1282273aad3420fbc26f3d759c7346b, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.723845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fe4b9-0085-4096-8607-141212217925 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.724019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.730252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9aea6-e994-4c5b-ace5-bec9709936d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.730927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9aea6-e994-4c5b-ace5-bec9709936d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.731169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9aea6-e994-4c5b-ace5-bec9709936d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.731449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9aea6-e994-4c5b-ace5-bec9709936d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.732103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9aea6-e994-4c5b-ace5-bec9709936d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.733742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9aea6-e994-4c5b-ace5-bec9709936d7 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.751609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 936/1873] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:50 2022] PUT /identity/v3/projects/ca3c9950632e43a3ae4c9618ad064b6e/users/e1282273aad3420fbc26f3d759c7346b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:50.751609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.751609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:50.751887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 938/1874] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:50.751887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9aea6-e994-4c5b-ace5-bec9709936d7 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.757509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:50.765304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9aea6-e994-4c5b-ace5-bec9709936d7 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.827197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a5e92-bbf6-40cd-9d3b-720661aa4e78 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:50.830763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded7374-7c8b-46a4-a060-04f74e78f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.831118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56566d-5ae2-4448-aa1b-bed9277d37a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:50.831439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded7374-7c8b-46a4-a060-04f74e78f86b admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.831827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded7374-7c8b-46a4-a060-04f74e78f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.831997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded7374-7c8b-46a4-a060-04f74e78f86b admin admin] PATH_INFO: `/v3/projects/dd59f7e208cd4741ac78bc48f47a16bc/users/a488c1b86a114ecc9474012ca7ce22c7/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.832089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56566d-5ae2-4448-aa1b-bed9277d37a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.832459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56566d-5ae2-4448-aa1b-bed9277d37a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.832833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56566d-5ae2-4448-aa1b-bed9277d37a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.834030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded7374-7c8b-46a4-a060-04f74e78f86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd59f7e208cd4741ac78bc48f47a16bc, user_id=a488c1b86a114ecc9474012ca7ce22c7, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.837470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded7374-7c8b-46a4-a060-04f74e78f86b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.848255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 939/1875] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:50 2022] PUT /identity/v3/projects/dd59f7e208cd4741ac78bc48f47a16bc/users/a488c1b86a114ecc9474012ca7ce22c7/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:50.849728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354559d-45da-4fff-96ab-28de512f36e5 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.849821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354559d-45da-4fff-96ab-28de512f36e5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.850086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354559d-45da-4fff-96ab-28de512f36e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.881835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a354559d-45da-4fff-96ab-28de512f36e5 None None] MFA Rules not processed for user `e1282273aad3420fbc26f3d759c7346b`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:50.883063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a354559d-45da-4fff-96ab-28de512f36e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:50.896587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:50.915627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56566d-5ae2-4448-aa1b-bed9277d37a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:50.917509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f56566d-5ae2-4448-aa1b-bed9277d37a2 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:50.940208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 937/1876] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:50.941607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830400-1830-4400-b94d-e9b38257e25b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:50.941900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830400-1830-4400-b94d-e9b38257e25b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:50.942189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830400-1830-4400-b94d-e9b38257e25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:50.967526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 940/1877] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:50.975171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354559d-45da-4fff-96ab-28de512f36e5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:50.988363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-65830400-1830-4400-b94d-e9b38257e25b None None] MFA Rules not processed for user `a488c1b86a114ecc9474012ca7ce22c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:50.989654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-65830400-1830-4400-b94d-e9b38257e25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:51.076860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354559d-45da-4fff-96ab-28de512f36e5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:51.082824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b9c09-ac8f-4d68-af7b-12f38ce151a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:51.083782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b9c09-ac8f-4d68-af7b-12f38ce151a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.084075 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b9c09-ac8f-4d68-af7b-12f38ce151a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.084357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b9c09-ac8f-4d68-af7b-12f38ce151a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.085017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b9c09-ac8f-4d68-af7b-12f38ce151a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:51.087805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b9c09-ac8f-4d68-af7b-12f38ce151a6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:51.097144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 938/1878] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:51.110619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830400-1830-4400-b94d-e9b38257e25b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:51.112646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-65830400-1830-4400-b94d-e9b38257e25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:51.134691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 941/1879] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:50 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:51.140645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b9c09-ac8f-4d68-af7b-12f38ce151a6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:51.188132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:51.204990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830400-1830-4400-b94d-e9b38257e25b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:51.224281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b9c09-ac8f-4d68-af7b-12f38ce151a6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:51.231871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349a79-e8ef-4c80-81fa-c81d6865af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:51.232638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349a79-e8ef-4c80-81fa-c81d6865af8f admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.233328 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349a79-e8ef-4c80-81fa-c81d6865af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.233648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8349a79-e8ef-4c80-81fa-c81d6865af8f admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.234299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8349a79-e8ef-4c80-81fa-c81d6865af8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:51.236723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8349a79-e8ef-4c80-81fa-c81d6865af8f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:51.263754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 942/1880] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:51 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:39:51.264424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349a79-e8ef-4c80-81fa-c81d6865af8f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:51.282289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:51.284286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.285414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.285714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.287816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:51.288570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8349a79-e8ef-4c80-81fa-c81d6865af8f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:51.302131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f600a49-d50a-4d21-97e1-6c7a358fb59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:51.302760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f600a49-d50a-4d21-97e1-6c7a358fb59e admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.303040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f600a49-d50a-4d21-97e1-6c7a358fb59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.303312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f600a49-d50a-4d21-97e1-6c7a358fb59e admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.303960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f600a49-d50a-4d21-97e1-6c7a358fb59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:51.305635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f600a49-d50a-4d21-97e1-6c7a358fb59e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:51.329342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 943/1881] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:39:51.333697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f600a49-d50a-4d21-97e1-6c7a358fb59e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:51.349466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f600a49-d50a-4d21-97e1-6c7a358fb59e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:51.358175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562629e6-40db-4eb6-acdf-8e1acb0f7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:51.360233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562629e6-40db-4eb6-acdf-8e1acb0f7d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.360233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562629e6-40db-4eb6-acdf-8e1acb0f7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.360233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562629e6-40db-4eb6-acdf-8e1acb0f7d14 admin admin] PATH_INFO: `/v3/projects/8c098035cfaa46128dd6ec8689e6a72c/users/1b2c66b54627486a907ec003388fb2be/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.387850 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562629e6-40db-4eb6-acdf-8e1acb0f7d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c098035cfaa46128dd6ec8689e6a72c, user_id=1b2c66b54627486a907ec003388fb2be, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:51.391653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562629e6-40db-4eb6-acdf-8e1acb0f7d14 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:51.395323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:51.419622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 944/1882] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:51 2022] PUT /identity/v3/projects/8c098035cfaa46128dd6ec8689e6a72c/users/1b2c66b54627486a907ec003388fb2be/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:51.423663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562629e6-40db-4eb6-acdf-8e1acb0f7d14 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:51.426122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:51.427717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:51.437808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 939/1883] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:39:51.503804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562629e6-40db-4eb6-acdf-8e1acb0f7d14 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:51.527017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea29ea3-8513-4284-89c6-2ea89de87402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:51.527840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29ea3-8513-4284-89c6-2ea89de87402 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.528215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29ea3-8513-4284-89c6-2ea89de87402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.528605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29ea3-8513-4284-89c6-2ea89de87402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.529352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea29ea3-8513-4284-89c6-2ea89de87402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:51.532039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea29ea3-8513-4284-89c6-2ea89de87402 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:51.544159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 945/1884] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:51.548491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:51.561320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea696bf-4590-48b3-9fee-896ae2cc5156 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:51.572953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b430351-3914-4534-8373-beb6032f8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:51.574568 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430351-3914-4534-8373-beb6032f8b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.575034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430351-3914-4534-8373-beb6032f8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.575472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b430351-3914-4534-8373-beb6032f8b45 admin admin] PATH_INFO: `/v3/projects/8c098035cfaa46128dd6ec8689e6a72c/users/1b2c66b54627486a907ec003388fb2be/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.578710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b430351-3914-4534-8373-beb6032f8b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c098035cfaa46128dd6ec8689e6a72c, user_id=1b2c66b54627486a907ec003388fb2be, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:51.582412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b430351-3914-4534-8373-beb6032f8b45 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:51.609139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 940/1885] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:51 2022] PUT /identity/v3/projects/8c098035cfaa46128dd6ec8689e6a72c/users/1b2c66b54627486a907ec003388fb2be/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:51.609482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39265c02-45ca-48fb-9bfc-02ce7793085c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.609800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39265c02-45ca-48fb-9bfc-02ce7793085c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.610561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39265c02-45ca-48fb-9bfc-02ce7793085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.647254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-39265c02-45ca-48fb-9bfc-02ce7793085c None None] MFA Rules not processed for user `1b2c66b54627486a907ec003388fb2be`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:51.648609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-39265c02-45ca-48fb-9bfc-02ce7793085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:51.737854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 946/1886] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:51.749792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b430351-3914-4534-8373-beb6032f8b45 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:51.826502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b430351-3914-4534-8373-beb6032f8b45 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:51.830729 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c311a-9d5b-4bad-ae5f-e47fee987868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:51.831626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c311a-9d5b-4bad-ae5f-e47fee987868 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:51.832098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c311a-9d5b-4bad-ae5f-e47fee987868 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:51.832575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c311a-9d5b-4bad-ae5f-e47fee987868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:51.843631 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c311a-9d5b-4bad-ae5f-e47fee987868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:51.845271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c311a-9d5b-4bad-ae5f-e47fee987868 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:51.858018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 941/1887] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:52.573303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39265c02-45ca-48fb-9bfc-02ce7793085c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:52.583810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39265c02-45ca-48fb-9bfc-02ce7793085c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:52.588080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b428e9-4177-47fa-9686-a50c2ed17970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:52.588847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b428e9-4177-47fa-9686-a50c2ed17970 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:52.588962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b428e9-4177-47fa-9686-a50c2ed17970 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:52.589214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b428e9-4177-47fa-9686-a50c2ed17970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:52.659636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b428e9-4177-47fa-9686-a50c2ed17970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:52.661446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b428e9-4177-47fa-9686-a50c2ed17970 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:52.673630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 947/1888] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:53.208664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c311a-9d5b-4bad-ae5f-e47fee987868 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:53.217903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c311a-9d5b-4bad-ae5f-e47fee987868 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:53.221849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:53.222456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:53.222732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:53.222999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:53.269469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:53.286210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:53.287921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:53.299112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 942/1889] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:53.983310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b428e9-4177-47fa-9686-a50c2ed17970 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:53.993544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b428e9-4177-47fa-9686-a50c2ed17970 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:53.997809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d7b25-1f5b-41d0-b33d-5ee0d88c7758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:53.998444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d7b25-1f5b-41d0-b33d-5ee0d88c7758 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:53.998867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d7b25-1f5b-41d0-b33d-5ee0d88c7758 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:53.999107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d7b25-1f5b-41d0-b33d-5ee0d88c7758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:54.010525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:54.084955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d7b25-1f5b-41d0-b33d-5ee0d88c7758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:54.086158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d7b25-1f5b-41d0-b33d-5ee0d88c7758 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:54.097538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 948/1890] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:54.610593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:54.612136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:54.681414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359697-200e-474c-bee8-e7920b9b1265 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:54.686217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:54.686852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:54.687135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:54.687469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] PATH_INFO: `/v3/users/04a5495b3dc34c35931fd141a4542e9b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:54.688679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a5495b3dc34c35931fd141a4542e9b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:54.690733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:54.738706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a5495b3dc34c35931fd141a4542e9b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:54.739431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a5495b3dc34c35931fd141a4542e9b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:54.747041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a5495b3dc34c35931fd141a4542e9b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:54.747680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a5495b3dc34c35931fd141a4542e9b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:54.755433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a5495b3dc34c35931fd141a4542e9b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:54.778005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 943/1891] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:54 2022] DELETE /identity/v3/users/04a5495b3dc34c35931fd141a4542e9b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:54.782622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970448d-525e-4dd2-ac78-cfae6b43bf01 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:54.782911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970448d-525e-4dd2-ac78-cfae6b43bf01 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:54.783226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970448d-525e-4dd2-ac78-cfae6b43bf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:54.802792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-c970448d-525e-4dd2-ac78-cfae6b43bf01 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:54.803975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c970448d-525e-4dd2-ac78-cfae6b43bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:54.875237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 949/1892] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:54.885821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:54.887552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:54.951770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca9d07-1a89-4bea-98b4-e6508121e1b2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:54.976225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05529-d5a6-4e2c-8f44-a30291fefe53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:54.978230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05529-d5a6-4e2c-8f44-a30291fefe53 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:54.979530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05529-d5a6-4e2c-8f44-a30291fefe53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:54.979997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05529-d5a6-4e2c-8f44-a30291fefe53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:54.993646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c05529-d5a6-4e2c-8f44-a30291fefe53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:54.995196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c05529-d5a6-4e2c-8f44-a30291fefe53 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:55.005679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 944/1893] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:55.288981 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970448d-525e-4dd2-ac78-cfae6b43bf01 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:55.291780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c970448d-525e-4dd2-ac78-cfae6b43bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:55.305112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970448d-525e-4dd2-ac78-cfae6b43bf01 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:55.310462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:55.313774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:55.314070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:55.314354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] PATH_INFO: `/v3/projects/f3122f8764f54f50a5963df4af37a9fb` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:55.315585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3122f8764f54f50a5963df4af37a9fb)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:55.317755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:55.379921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3122f8764f54f50a5963df4af37a9fb', 'request_id': 'req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.390109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3122f8764f54f50a5963df4af37a9fb', 'request_id': 'req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.398411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3122f8764f54f50a5963df4af37a9fb', 'request_id': 'req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.413155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] The token cache is being invalidate because project f3122f8764f54f50a5963df4af37a9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:55.413448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.414573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.417847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 950/1894] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:55 2022] DELETE /identity/v3/projects/f3122f8764f54f50a5963df4af37a9fb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:55.425138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05529-d5a6-4e2c-8f44-a30291fefe53 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:55.437816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:55.461441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05529-d5a6-4e2c-8f44-a30291fefe53 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:55.584108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:55.585135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:55.585710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:55.586202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] PATH_INFO: `/v3/users/03c247d3dda9467483b9e23b0fe451c4` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:55.588306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c247d3dda9467483b9e23b0fe451c4)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:55.592642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:55.699472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c247d3dda9467483b9e23b0fe451c4'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.721764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c247d3dda9467483b9e23b0fe451c4'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.734359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c247d3dda9467483b9e23b0fe451c4'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.735238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c247d3dda9467483b9e23b0fe451c4'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.743752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1af12878-feac-46ad-8a15-efe229c46abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c247d3dda9467483b9e23b0fe451c4'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:55.772737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 945/1895] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:55 2022] DELETE /identity/v3/users/03c247d3dda9467483b9e23b0fe451c4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:56.507902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:56.510078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:56.524302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8ce2d-c877-47c6-8bd9-3380931e18ce admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:56.559213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:56.592377 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:56.593091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:56.593399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:56.593704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] PATH_INFO: `/v3/projects/d448c6f1608f4526b681507cd9736c12` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:56.594872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d448c6f1608f4526b681507cd9736c12)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:56.596869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:56.644493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd448c6f1608f4526b681507cd9736c12', 'request_id': 'req-a3eac271-dac3-46fb-bb65-dc420e317a03'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:56.652231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd448c6f1608f4526b681507cd9736c12', 'request_id': 'req-a3eac271-dac3-46fb-bb65-dc420e317a03'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:56.659856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd448c6f1608f4526b681507cd9736c12', 'request_id': 'req-a3eac271-dac3-46fb-bb65-dc420e317a03'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:56.672014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] The token cache is being invalidate because project d448c6f1608f4526b681507cd9736c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:56.672373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:56.673067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a3eac271-dac3-46fb-bb65-dc420e317a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:56.674644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 951/1896] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:56 2022] DELETE /identity/v3/projects/d448c6f1608f4526b681507cd9736c12 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:56.679734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cb6a-3d2a-4b42-9e9e-7539306d52a1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:56.680040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cb6a-3d2a-4b42-9e9e-7539306d52a1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:56.680862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cb6a-3d2a-4b42-9e9e-7539306d52a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:56.701269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-bb96cb6a-3d2a-4b42-9e9e-7539306d52a1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:56.703009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bb96cb6a-3d2a-4b42-9e9e-7539306d52a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:56.767682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 946/1897] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:56.776697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f52f-e025-47f0-aba8-141d53b7cec7 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:56.776697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f52f-e025-47f0-aba8-141d53b7cec7 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:56.776885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f52f-e025-47f0-aba8-141d53b7cec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:56.797259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-4ff3f52f-e025-47f0-aba8-141d53b7cec7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:56.798533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4ff3f52f-e025-47f0-aba8-141d53b7cec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:56.806933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 952/1898] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:56.811391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96cb6a-3d2a-4b42-9e9e-7539306d52a1 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:56.826140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96cb6a-3d2a-4b42-9e9e-7539306d52a1 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:56.827558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:56.828372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:56.828567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:56.828848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:56.829721 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:39:56.830035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:56.831694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:56.845490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 947/1899] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:39:56.850029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3f52f-e025-47f0-aba8-141d53b7cec7 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:56.860245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3f52f-e025-47f0-aba8-141d53b7cec7 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:56.865482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3ca0c-14c9-49ed-8170-726891f58710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:56.866173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3ca0c-14c9-49ed-8170-726891f58710 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:56.866489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3ca0c-14c9-49ed-8170-726891f58710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:56.866801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3ca0c-14c9-49ed-8170-726891f58710 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:56.867459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3ca0c-14c9-49ed-8170-726891f58710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:56.869610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3ca0c-14c9-49ed-8170-726891f58710 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:56.899997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 953/1900] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:56 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:56.904548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:56.920461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426aba3-84e4-4aba-8249-7c729ef1f793 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:56.929454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:56.988340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da9a1-9778-46e3-a86a-420d23116c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:56.988992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da9a1-9778-46e3-a86a-420d23116c9d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:56.989492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da9a1-9778-46e3-a86a-420d23116c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:56.990044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743da9a1-9778-46e3-a86a-420d23116c9d admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:56.990907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743da9a1-9778-46e3-a86a-420d23116c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:56.993074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743da9a1-9778-46e3-a86a-420d23116c9d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.027884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 948/1901] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:56 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:57.030039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3ca0c-14c9-49ed-8170-726891f58710 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.043796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3ca0c-14c9-49ed-8170-726891f58710 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.050910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf1177-6b9c-4723-9057-6fcf4b86aab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.051799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf1177-6b9c-4723-9057-6fcf4b86aab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.052346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf1177-6b9c-4723-9057-6fcf4b86aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.052679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf1177-6b9c-4723-9057-6fcf4b86aab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.053439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf1177-6b9c-4723-9057-6fcf4b86aab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.055324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf1177-6b9c-4723-9057-6fcf4b86aab2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.077243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 954/1902] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:39:57.077744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da9a1-9778-46e3-a86a-420d23116c9d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.089876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743da9a1-9778-46e3-a86a-420d23116c9d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.095049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de83d91-5362-4fd7-b728-a5da403c1c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.095884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83d91-5362-4fd7-b728-a5da403c1c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.096199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83d91-5362-4fd7-b728-a5da403c1c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.096353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83d91-5362-4fd7-b728-a5da403c1c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.097035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de83d91-5362-4fd7-b728-a5da403c1c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.098815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de83d91-5362-4fd7-b728-a5da403c1c3f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.113562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 949/1903] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:39:57.116469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf1177-6b9c-4723-9057-6fcf4b86aab2 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.137257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf1177-6b9c-4723-9057-6fcf4b86aab2 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.142647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.143574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.143887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.144277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] PATH_INFO: `/v3/projects/21f14c4352b94c8ba4895d84a6180cd4/users/6933c0f9ca294db39e75fb9903ce9609/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.179195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f14c4352b94c8ba4895d84a6180cd4, user_id=6933c0f9ca294db39e75fb9903ce9609, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.184125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.209170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 955/1904] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:57 2022] PUT /identity/v3/projects/21f14c4352b94c8ba4895d84a6180cd4/users/6933c0f9ca294db39e75fb9903ce9609/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:57.220320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25dd86-3297-47ad-b8c1-50c1dff4812e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.221898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25dd86-3297-47ad-b8c1-50c1dff4812e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.222288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25dd86-3297-47ad-b8c1-50c1dff4812e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.284380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1e25dd86-3297-47ad-b8c1-50c1dff4812e None None] MFA Rules not processed for user `6933c0f9ca294db39e75fb9903ce9609`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:57.286002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1e25dd86-3297-47ad-b8c1-50c1dff4812e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:57.287057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.288923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:57.414426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 950/1905] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:57.419021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc67c-4188-4d3d-8bb3-bd3387fb1ee2 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.420197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25dd86-3297-47ad-b8c1-50c1dff4812e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.424685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.427934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.428429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.428935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.433021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:57.452685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:57.549216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25dd86-3297-47ad-b8c1-50c1dff4812e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.565825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc3a4-30ea-48c8-ac09-149fb7e67fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.566465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc3a4-30ea-48c8-ac09-149fb7e67fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.566747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc3a4-30ea-48c8-ac09-149fb7e67fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.567022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc3a4-30ea-48c8-ac09-149fb7e67fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.567747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc3a4-30ea-48c8-ac09-149fb7e67fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.571123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc3a4-30ea-48c8-ac09-149fb7e67fc3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.589977 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.594489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.610372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 956/1906] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:57.618279 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 951/1907] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:39:57 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:57.620643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.646115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac88740-004c-4087-95e2-070936506b93 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.738324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4002-f0a0-42da-9430-cd501ee4da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.738980 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4002-f0a0-42da-9430-cd501ee4da28 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.739266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4002-f0a0-42da-9430-cd501ee4da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.739540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4002-f0a0-42da-9430-cd501ee4da28 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.740168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a4002-f0a0-42da-9430-cd501ee4da28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.742552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a4002-f0a0-42da-9430-cd501ee4da28 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.774872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 957/1908] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:39:57 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:39:57.776088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc3a4-30ea-48c8-ac09-149fb7e67fc3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.785854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:57.790339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc3a4-30ea-48c8-ac09-149fb7e67fc3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.797475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888317bd-874d-4929-9b85-6c20354f1af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.799010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888317bd-874d-4929-9b85-6c20354f1af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.799425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888317bd-874d-4929-9b85-6c20354f1af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.799799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888317bd-874d-4929-9b85-6c20354f1af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.800582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888317bd-874d-4929-9b85-6c20354f1af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.803661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888317bd-874d-4929-9b85-6c20354f1af0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.820404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4002-f0a0-42da-9430-cd501ee4da28 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.822452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 952/1909] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:39:57.834519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4002-f0a0-42da-9430-cd501ee4da28 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.847004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f93832-4fdc-41b9-802a-369332961230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.847884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93832-4fdc-41b9-802a-369332961230 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.848318 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93832-4fdc-41b9-802a-369332961230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.848746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93832-4fdc-41b9-802a-369332961230 admin admin] PATH_INFO: `/v3/projects/6ddd59ce246d45c988b86de150368e1e/users/302889bc0bbe4456aa4da27fa472de38/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.865829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f93832-4fdc-41b9-802a-369332961230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddd59ce246d45c988b86de150368e1e, user_id=302889bc0bbe4456aa4da27fa472de38, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.869072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f93832-4fdc-41b9-802a-369332961230 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.883079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 958/1910] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:57 2022] PUT /identity/v3/projects/6ddd59ce246d45c988b86de150368e1e/users/302889bc0bbe4456aa4da27fa472de38/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:39:57.888412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888317bd-874d-4929-9b85-6c20354f1af0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.899652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888317bd-874d-4929-9b85-6c20354f1af0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.962294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbc816-c678-4065-95d9-ea487cc2f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.962917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbc816-c678-4065-95d9-ea487cc2f233 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:57.963202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbc816-c678-4065-95d9-ea487cc2f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:57.963481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbc816-c678-4065-95d9-ea487cc2f233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:57.964130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbc816-c678-4065-95d9-ea487cc2f233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:57.965889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbc816-c678-4065-95d9-ea487cc2f233 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:57.975737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 953/1911] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:39:57.980794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f93832-4fdc-41b9-802a-369332961230 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:57.992633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f93832-4fdc-41b9-802a-369332961230 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:57.999011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31c317-c924-44db-ae3b-110f10841c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:57.999890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c317-c924-44db-ae3b-110f10841c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:58.000496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c317-c924-44db-ae3b-110f10841c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:58.001179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c317-c924-44db-ae3b-110f10841c03 admin admin] PATH_INFO: `/v3/projects/6ddd59ce246d45c988b86de150368e1e/users/302889bc0bbe4456aa4da27fa472de38/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:58.004902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31c317-c924-44db-ae3b-110f10841c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddd59ce246d45c988b86de150368e1e, user_id=302889bc0bbe4456aa4da27fa472de38, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:58.010682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31c317-c924-44db-ae3b-110f10841c03 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:58.022320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 959/1912] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:39:57 2022] PUT /identity/v3/projects/6ddd59ce246d45c988b86de150368e1e/users/302889bc0bbe4456aa4da27fa472de38/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:39:58.034297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1117d0-2078-4a83-b267-4bc29e81fa55 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:58.034684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1117d0-2078-4a83-b267-4bc29e81fa55 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:58.035040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1117d0-2078-4a83-b267-4bc29e81fa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:58.066242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2a1117d0-2078-4a83-b267-4bc29e81fa55 None None] MFA Rules not processed for user `302889bc0bbe4456aa4da27fa472de38`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:58.067513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2a1117d0-2078-4a83-b267-4bc29e81fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:58.150238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 954/1913] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:39:58.158395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31c317-c924-44db-ae3b-110f10841c03 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:58.248684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31c317-c924-44db-ae3b-110f10841c03 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:58.252809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:58.253529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:58.253921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:58.254900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:58.267893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:58.269465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:58.288591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 960/1914] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:58.399822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1117d0-2078-4a83-b267-4bc29e81fa55 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:58.406278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:58.407748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:58.410205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1117d0-2078-4a83-b267-4bc29e81fa55 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:58.414142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b60f-5bbd-4fa5-849d-7320b13deca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:58.415870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b60f-5bbd-4fa5-849d-7320b13deca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:58.416300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b60f-5bbd-4fa5-849d-7320b13deca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:58.416828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b60f-5bbd-4fa5-849d-7320b13deca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:58.418790 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:58.486590 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b60f-5bbd-4fa5-849d-7320b13deca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:58.488217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b60f-5bbd-4fa5-849d-7320b13deca2 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:58.489906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78768-ecd0-4181-8921-cc86a2c7c747 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:58.498474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:58.499603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:58.500132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:58.500645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] PATH_INFO: `/v3/users/f2f0113f777f4757821f978999ba1c53` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:58.502462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f0113f777f4757821f978999ba1c53)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:58.505332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:58.508021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 955/1915] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:58.579944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f0113f777f4757821f978999ba1c53'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:58.590285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f0113f777f4757821f978999ba1c53'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:58.591275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f0113f777f4757821f978999ba1c53'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:58.592019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f0113f777f4757821f978999ba1c53'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:58.603220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f0113f777f4757821f978999ba1c53'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:58.646132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 961/1916] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:58 2022] DELETE /identity/v3/users/f2f0113f777f4757821f978999ba1c53 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:58.651317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e728845-7e43-4af1-b5dc-d0712f865d87 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:58.651611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e728845-7e43-4af1-b5dc-d0712f865d87 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:58.651894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e728845-7e43-4af1-b5dc-d0712f865d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:58.690185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0e728845-7e43-4af1-b5dc-d0712f865d87 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:58.691742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0e728845-7e43-4af1-b5dc-d0712f865d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:58.707420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:58.790506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 956/1917] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:39:58.801049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:58.802888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:58.876023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09498709-a24f-44f4-a16c-907d983279ad admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:58.881287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599dcf6-adb1-491d-9314-220ee8ce374b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:58.881950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599dcf6-adb1-491d-9314-220ee8ce374b service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:58.882405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599dcf6-adb1-491d-9314-220ee8ce374b service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:58.882536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599dcf6-adb1-491d-9314-220ee8ce374b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:58.910255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599dcf6-adb1-491d-9314-220ee8ce374b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:58.910255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599dcf6-adb1-491d-9314-220ee8ce374b service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:58.920994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 962/1918] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:39:59.429062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e728845-7e43-4af1-b5dc-d0712f865d87 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:59.431903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0e728845-7e43-4af1-b5dc-d0712f865d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:59.448590 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e728845-7e43-4af1-b5dc-d0712f865d87 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:59.454313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:59.454984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:59.455269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:59.455551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] PATH_INFO: `/v3/projects/04ad17fdbe8a4326a57aba9675f224d1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:59.456782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ad17fdbe8a4326a57aba9675f224d1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:59.458773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:59.515405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ad17fdbe8a4326a57aba9675f224d1', 'request_id': 'req-2cae9c90-4955-4b1c-bc63-ffffe0907a42'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.523965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ad17fdbe8a4326a57aba9675f224d1', 'request_id': 'req-2cae9c90-4955-4b1c-bc63-ffffe0907a42'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.532417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ad17fdbe8a4326a57aba9675f224d1', 'request_id': 'req-2cae9c90-4955-4b1c-bc63-ffffe0907a42'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.545053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] The token cache is being invalidate because project 04ad17fdbe8a4326a57aba9675f224d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:39:59.545253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.545985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2cae9c90-4955-4b1c-bc63-ffffe0907a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.547672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 957/1919] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:39:59 2022] DELETE /identity/v3/projects/04ad17fdbe8a4326a57aba9675f224d1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:59.551875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599dcf6-adb1-491d-9314-220ee8ce374b service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:39:59.562415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599dcf6-adb1-491d-9314-220ee8ce374b service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:39:59.591340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:39:59.629309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:39:59.630208 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:59.630603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:59.631011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] PATH_INFO: `/v3/users/9df4994170274a1293946fda22ae93ab` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:59.632357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df4994170274a1293946fda22ae93ab)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:39:59.634789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:39:59.712783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df4994170274a1293946fda22ae93ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.717292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebb17b-5105-422d-8a32-0453678a2ea0 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:59.717619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebb17b-5105-422d-8a32-0453678a2ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:59.717919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebb17b-5105-422d-8a32-0453678a2ea0 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:59.720134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 958/1920] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:39:59.738263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9478e-b97b-4a51-bac1-7a691105e9cc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:39:59.738458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9478e-b97b-4a51-bac1-7a691105e9cc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:39:59.738826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9478e-b97b-4a51-bac1-7a691105e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:39:59.742737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df4994170274a1293946fda22ae93ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.745278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df4994170274a1293946fda22ae93ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.747127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df4994170274a1293946fda22ae93ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.760891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df4994170274a1293946fda22ae93ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:39:59.788408 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cbc9478e-b97b-4a51-bac1-7a691105e9cc None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:39:59.791391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cbc9478e-b97b-4a51-bac1-7a691105e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:39:59.798833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 963/1921] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:39:59 2022] DELETE /identity/v3/users/9df4994170274a1293946fda22ae93ab => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:39:59.920570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 959/1922] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:00.339422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:00.349048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:00.399621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22557416-8efb-4892-8307-cd249326c387 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:00.423557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:00.426781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:00.427456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:00.429393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:00.464559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:00.466358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:00.500608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 964/1923] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:00.572824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9478e-b97b-4a51-bac1-7a691105e9cc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:00.574425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cbc9478e-b97b-4a51-bac1-7a691105e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:00.609955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:00.612922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:00.650870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:00.747599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9478e-b97b-4a51-bac1-7a691105e9cc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:00.755982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:00.757065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:00.757352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:00.757718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] PATH_INFO: `/v3/users/02aad06d19a54bb9b34efd0ac4c1c4d1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:00.759760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02aad06d19a54bb9b34efd0ac4c1c4d1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:00.761726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:00.781135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f21b1-a8dc-48a3-92fd-39373875e30a service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:00.786572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:00.787427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:00.787848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:00.788125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] PATH_INFO: `/v3/projects/d52b18a293ae4ec49d0d76488c4df1a3` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:00.790010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52b18a293ae4ec49d0d76488c4df1a3)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:00.792089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:00.826284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02aad06d19a54bb9b34efd0ac4c1c4d1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.840285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02aad06d19a54bb9b34efd0ac4c1c4d1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.846792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:00.855871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02aad06d19a54bb9b34efd0ac4c1c4d1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.856912 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02aad06d19a54bb9b34efd0ac4c1c4d1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.863136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52b18a293ae4ec49d0d76488c4df1a3', 'request_id': 'req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.869351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3df5ed7b-7162-4be4-bc58-db2c02abca04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02aad06d19a54bb9b34efd0ac4c1c4d1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.873071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52b18a293ae4ec49d0d76488c4df1a3', 'request_id': 'req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.882435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52b18a293ae4ec49d0d76488c4df1a3', 'request_id': 'req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.895501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 960/1924] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:00 2022] DELETE /identity/v3/users/02aad06d19a54bb9b34efd0ac4c1c4d1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:00.903877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e06842-ad5c-40c1-b3c1-a2a23d729435 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:00.904175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e06842-ad5c-40c1-b3c1-a2a23d729435 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:00.904448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e06842-ad5c-40c1-b3c1-a2a23d729435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:00.908202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] The token cache is being invalidate because project d52b18a293ae4ec49d0d76488c4df1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:00.909482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.911196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:00.914145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 965/1925] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:00 2022] DELETE /identity/v3/projects/d52b18a293ae4ec49d0d76488c4df1a3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:00.918940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:00.922213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:00.929929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-58e06842-ad5c-40c1-b3c1-a2a23d729435 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:00.931796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-58e06842-ad5c-40c1-b3c1-a2a23d729435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:01.015546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 961/1926] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:01.016948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d5407-0bcc-4ca6-8cb1-c8c12e8f82c2 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:01.027333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e06842-ad5c-40c1-b3c1-a2a23d729435 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:01.028099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:01.029702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:01.030260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:01.030428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-58e06842-ad5c-40c1-b3c1-a2a23d729435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:01.030547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] PATH_INFO: `/v3/users/a488c1b86a114ecc9474012ca7ce22c7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:01.031553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a488c1b86a114ecc9474012ca7ce22c7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:01.034890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:01.091932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a488c1b86a114ecc9474012ca7ce22c7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:01.101769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a488c1b86a114ecc9474012ca7ce22c7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:01.103322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a488c1b86a114ecc9474012ca7ce22c7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:01.104299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a488c1b86a114ecc9474012ca7ce22c7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:01.106869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:01.111681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e06842-ad5c-40c1-b3c1-a2a23d729435 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:01.114762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a488c1b86a114ecc9474012ca7ce22c7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:01.116863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:01.117599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:01.118449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:01.119170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:01.121895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:01.134869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:01.135670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 966/1927] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:00 2022] DELETE /identity/v3/users/a488c1b86a114ecc9474012ca7ce22c7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:01.136418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:01.146654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 962/1928] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:01.671180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:01.673072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:01.688445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:01.694570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:01.718117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4571a-c7f4-441a-8225-4b7d39b2e61d service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:01.797638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:01.827616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf3112-8a62-4be7-8049-deba024f8e75 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:01.848657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:01.850445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:01.850445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:01.850445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] PATH_INFO: `/v3/projects/dd59f7e208cd4741ac78bc48f47a16bc` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:01.853898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd59f7e208cd4741ac78bc48f47a16bc)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:01.856586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:01.886199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:01.886603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:01.886603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:01.886871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] PATH_INFO: `/v3/projects/8f566edd18f0406fbaa86d538b20c120` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:01.888676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f566edd18f0406fbaa86d538b20c120)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:01.893655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:02.000362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd59f7e208cd4741ac78bc48f47a16bc', 'request_id': 'req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.018691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f566edd18f0406fbaa86d538b20c120', 'request_id': 'req-f4141246-1135-4afa-b9eb-46efd6341127'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.033900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd59f7e208cd4741ac78bc48f47a16bc', 'request_id': 'req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.041264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f566edd18f0406fbaa86d538b20c120', 'request_id': 'req-f4141246-1135-4afa-b9eb-46efd6341127'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.047454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd59f7e208cd4741ac78bc48f47a16bc', 'request_id': 'req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.054854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f566edd18f0406fbaa86d538b20c120', 'request_id': 'req-f4141246-1135-4afa-b9eb-46efd6341127'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.082147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] The token cache is being invalidate because project dd59f7e208cd4741ac78bc48f47a16bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:02.082685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.083937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0595b5ee-3b6d-4d49-8f10-1a7bec30553f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.086442 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 967/1929] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:01 2022] DELETE /identity/v3/projects/dd59f7e208cd4741ac78bc48f47a16bc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:02.091209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] The token cache is being invalidate because project 8f566edd18f0406fbaa86d538b20c120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:02.091528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.092670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.093138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5e95-32dd-4cdc-8c51-f168eacf9e86 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.093500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5e95-32dd-4cdc-8c51-f168eacf9e86 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.094936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5e95-32dd-4cdc-8c51-f168eacf9e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.099006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 963/1930] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:01 2022] DELETE /identity/v3/projects/8f566edd18f0406fbaa86d538b20c120 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:02.099974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:02.103720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:02.142147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b24c5e95-32dd-4cdc-8c51-f168eacf9e86 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:02.144336 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b24c5e95-32dd-4cdc-8c51-f168eacf9e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:02.266067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 968/1931] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:02.274319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3513af1-6fc4-4343-8458-40d38d37d1c2 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.275051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4141246-1135-4afa-b9eb-46efd6341127 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:02.275405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3513af1-6fc4-4343-8458-40d38d37d1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.276485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3513af1-6fc4-4343-8458-40d38d37d1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.280694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:02.281574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.282068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.282494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] PATH_INFO: `/v3/users/e1282273aad3420fbc26f3d759c7346b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.284046 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1282273aad3420fbc26f3d759c7346b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:02.288455 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:02.320892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-d3513af1-6fc4-4343-8458-40d38d37d1c2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:02.323211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d3513af1-6fc4-4343-8458-40d38d37d1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:02.334920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 969/1932] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:02.340032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3513af1-6fc4-4343-8458-40d38d37d1c2 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:02.350235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3513af1-6fc4-4343-8458-40d38d37d1c2 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:02.357294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:02.360137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:02.361823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.362429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.363733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.373192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:02.373476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:02.377182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:02.412892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1282273aad3420fbc26f3d759c7346b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.413110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 970/1933] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:40:02.414023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:02.414370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1282273aad3420fbc26f3d759c7346b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.416262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:02.425500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1282273aad3420fbc26f3d759c7346b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.426920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1282273aad3420fbc26f3d759c7346b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.431400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943acf52-e72c-4285-9a09-18a40e878979 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:02.438904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4cda2-4e89-494c-832a-9eee92a40c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:02.439735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4cda2-4e89-494c-832a-9eee92a40c9d admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.440070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4cda2-4e89-494c-832a-9eee92a40c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.440555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1282273aad3420fbc26f3d759c7346b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:02.440695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4cda2-4e89-494c-832a-9eee92a40c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.441248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4cda2-4e89-494c-832a-9eee92a40c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:02.444041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4cda2-4e89-494c-832a-9eee92a40c9d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:02.474501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 964/1934] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:02 2022] DELETE /identity/v3/users/e1282273aad3420fbc26f3d759c7346b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:02.487947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 971/1935] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:02 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:02.494448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:02.577494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cd585-cc74-4b70-a153-05a4eb0569cf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:02.683446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb003c-ae06-4801-98f4-db07b599ac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:02.684264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb003c-ae06-4801-98f4-db07b599ac56 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.684553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb003c-ae06-4801-98f4-db07b599ac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.685493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb003c-ae06-4801-98f4-db07b599ac56 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.686248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb003c-ae06-4801-98f4-db07b599ac56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:02.692230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb003c-ae06-4801-98f4-db07b599ac56 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:02.732256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 965/1936] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:02 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:02.736026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4cda2-4e89-494c-832a-9eee92a40c9d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:02.747618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4cda2-4e89-494c-832a-9eee92a40c9d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:02.753115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a96a7d-ede4-4912-92ba-ff43d7b904cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:02.753853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a96a7d-ede4-4912-92ba-ff43d7b904cb admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.754135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a96a7d-ede4-4912-92ba-ff43d7b904cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.754418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a96a7d-ede4-4912-92ba-ff43d7b904cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.755079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a96a7d-ede4-4912-92ba-ff43d7b904cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:02.756703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a96a7d-ede4-4912-92ba-ff43d7b904cb admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:02.768818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 972/1937] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:02.773422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb003c-ae06-4801-98f4-db07b599ac56 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:02.785795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb003c-ae06-4801-98f4-db07b599ac56 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:02.790321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c7c0b-6c2b-4075-93cf-903afa7c02dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:02.790939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7c0b-6c2b-4075-93cf-903afa7c02dc admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.791253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7c0b-6c2b-4075-93cf-903afa7c02dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.791523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c7c0b-6c2b-4075-93cf-903afa7c02dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.792168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c7c0b-6c2b-4075-93cf-903afa7c02dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:02.793799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26c7c0b-6c2b-4075-93cf-903afa7c02dc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:02.808173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 966/1938] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:02.809422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a96a7d-ede4-4912-92ba-ff43d7b904cb admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:02.819783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a96a7d-ede4-4912-92ba-ff43d7b904cb admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:02.824597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:02.825262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.825582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.825874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] PATH_INFO: `/v3/projects/f028b1d99ce64905940319325a7ee8cb/users/b6f9bef4a2db496188959dc3093a392d/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.842307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f028b1d99ce64905940319325a7ee8cb, user_id=b6f9bef4a2db496188959dc3093a392d, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:02.844974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:02.855053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:02.863163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 973/1939] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:02 2022] PUT /identity/v3/projects/f028b1d99ce64905940319325a7ee8cb/users/b6f9bef4a2db496188959dc3093a392d/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:02.874027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef19b85-9e9a-4843-b68d-65e2a44fbb03 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:02.874755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef19b85-9e9a-4843-b68d-65e2a44fbb03 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:02.875165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef19b85-9e9a-4843-b68d-65e2a44fbb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:02.910939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-0ef19b85-9e9a-4843-b68d-65e2a44fbb03 None None] MFA Rules not processed for user `b6f9bef4a2db496188959dc3093a392d`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:02.912361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0ef19b85-9e9a-4843-b68d-65e2a44fbb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:02.927235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:02.998882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:03.000626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:03.008983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 967/1940] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:03.025903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef19b85-9e9a-4843-b68d-65e2a44fbb03 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:03.027390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0ef19b85-9e9a-4843-b68d-65e2a44fbb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:03.085267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd3302-45ee-405b-8052-4f3858c568e6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:03.091071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:03.092070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:03.092350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:03.092824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] PATH_INFO: `/v3/projects/ca3c9950632e43a3ae4c9618ad064b6e` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:03.094032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3c9950632e43a3ae4c9618ad064b6e)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:03.096083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:03.103623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef19b85-9e9a-4843-b68d-65e2a44fbb03 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:03.107625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841cbe8-a3cb-4354-9750-097d44930d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:03.108250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841cbe8-a3cb-4354-9750-097d44930d98 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:03.108721 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841cbe8-a3cb-4354-9750-097d44930d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:03.109004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841cbe8-a3cb-4354-9750-097d44930d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:03.119775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841cbe8-a3cb-4354-9750-097d44930d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:03.121135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841cbe8-a3cb-4354-9750-097d44930d98 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:03.132007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 968/1941] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:03.156988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3c9950632e43a3ae4c9618ad064b6e', 'request_id': 'req-b411c266-0f5c-4545-a09b-15b370f9fe2c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.167509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3c9950632e43a3ae4c9618ad064b6e', 'request_id': 'req-b411c266-0f5c-4545-a09b-15b370f9fe2c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.174490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3c9950632e43a3ae4c9618ad064b6e', 'request_id': 'req-b411c266-0f5c-4545-a09b-15b370f9fe2c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.190342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] The token cache is being invalidate because project ca3c9950632e43a3ae4c9618ad064b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:03.190642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.191336 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.193553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 974/1942] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:02 2022] DELETE /identity/v3/projects/ca3c9950632e43a3ae4c9618ad064b6e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:03.197465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841cbe8-a3cb-4354-9750-097d44930d98 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:03.209494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841cbe8-a3cb-4354-9750-097d44930d98 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:03.280592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:03.281842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:03.282007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:03.282277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] PATH_INFO: `/v3/users/1b2c66b54627486a907ec003388fb2be` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:03.283630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2c66b54627486a907ec003388fb2be)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:03.285707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:03.344918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2c66b54627486a907ec003388fb2be'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.345777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2c66b54627486a907ec003388fb2be'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.354713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2c66b54627486a907ec003388fb2be'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.355583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2c66b54627486a907ec003388fb2be'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.359698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:03.364088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-48f0d698-7f70-495c-acfe-303c09a850cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2c66b54627486a907ec003388fb2be'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:03.391356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 969/1943] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:03 2022] DELETE /identity/v3/users/1b2c66b54627486a907ec003388fb2be => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:03.721616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:03.723179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:03.762744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411c266-0f5c-4545-a09b-15b370f9fe2c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:03.955826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:03.956851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:03.957280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:03.957723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] PATH_INFO: `/v3/projects/8c098035cfaa46128dd6ec8689e6a72c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:03.960098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c098035cfaa46128dd6ec8689e6a72c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:03.966015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:04.118724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:04.159027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c098035cfaa46128dd6ec8689e6a72c', 'request_id': 'req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:04.178576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c098035cfaa46128dd6ec8689e6a72c', 'request_id': 'req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:04.191165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c098035cfaa46128dd6ec8689e6a72c', 'request_id': 'req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:04.230119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] The token cache is being invalidate because project 8c098035cfaa46128dd6ec8689e6a72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:04.230564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:04.234298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4bd0b31c-6d7a-4144-888e-280ae8e3d8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:04.245258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711c66-8235-4313-aa55-c97a6692a628 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:04.245782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711c66-8235-4313-aa55-c97a6692a628 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:04.245862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711c66-8235-4313-aa55-c97a6692a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:04.249641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 975/1944] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:03 2022] DELETE /identity/v3/projects/8c098035cfaa46128dd6ec8689e6a72c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:04.296541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-02711c66-8235-4313-aa55-c97a6692a628 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:04.297878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-02711c66-8235-4313-aa55-c97a6692a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:04.480017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 970/1945] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:04.490036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432aaf2-6e3e-450b-81b0-ed1fb0c8ed57 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:04.490568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432aaf2-6e3e-450b-81b0-ed1fb0c8ed57 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:04.490953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432aaf2-6e3e-450b-81b0-ed1fb0c8ed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:04.589200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-d432aaf2-6e3e-450b-81b0-ed1fb0c8ed57 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:04.596712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d432aaf2-6e3e-450b-81b0-ed1fb0c8ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:04.623186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 976/1946] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:04.628145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711c66-8235-4313-aa55-c97a6692a628 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:04.648964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711c66-8235-4313-aa55-c97a6692a628 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:04.666744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:04.668913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:04.669907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:04.670954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:04.676017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:04.677770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:04.682969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:04.735114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 971/1947] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:04.740699 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432aaf2-6e3e-450b-81b0-ed1fb0c8ed57 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:04.807752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432aaf2-6e3e-450b-81b0-ed1fb0c8ed57 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:04.835350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c6c2-bada-463b-a305-2f32378f90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:04.842519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c6c2-bada-463b-a305-2f32378f90b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:04.845364 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c6c2-bada-463b-a305-2f32378f90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:04.847258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c6c2-bada-463b-a305-2f32378f90b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:04.853578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186c6c2-bada-463b-a305-2f32378f90b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:04.867116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186c6c2-bada-463b-a305-2f32378f90b3 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:04.947100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 977/1948] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:04 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:04.951791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:04.971042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e4cad-aa11-4f5d-a3d5-395dc30935d5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.098664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f4707-2bc6-4533-ba7a-f499279ba42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.099318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f4707-2bc6-4533-ba7a-f499279ba42c admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.099594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f4707-2bc6-4533-ba7a-f499279ba42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.099869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f4707-2bc6-4533-ba7a-f499279ba42c admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.100712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f4707-2bc6-4533-ba7a-f499279ba42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.103900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f4707-2bc6-4533-ba7a-f499279ba42c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.126587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 972/1949] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:04 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:05.130879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c6c2-bada-463b-a305-2f32378f90b3 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.141987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c6c2-bada-463b-a305-2f32378f90b3 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.146758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ce48d-f21e-46f1-831a-072029a57017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.147428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ce48d-f21e-46f1-831a-072029a57017 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.147720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ce48d-f21e-46f1-831a-072029a57017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.147996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ce48d-f21e-46f1-831a-072029a57017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.148653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ce48d-f21e-46f1-831a-072029a57017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.151037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ce48d-f21e-46f1-831a-072029a57017 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.165821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 978/1950] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:05.167123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f4707-2bc6-4533-ba7a-f499279ba42c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.184227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f4707-2bc6-4533-ba7a-f499279ba42c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.189552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9339040-aaff-4867-9751-d11b5cbc6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.190423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339040-aaff-4867-9751-d11b5cbc6dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.190715 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339040-aaff-4867-9751-d11b5cbc6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.191035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339040-aaff-4867-9751-d11b5cbc6dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.191783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339040-aaff-4867-9751-d11b5cbc6dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.193718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339040-aaff-4867-9751-d11b5cbc6dbd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.207067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 973/1951] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:05.212202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ce48d-f21e-46f1-831a-072029a57017 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.223778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ce48d-f21e-46f1-831a-072029a57017 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.236028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0327f99-9c72-4a21-900f-43bf1783e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.236818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327f99-9c72-4a21-900f-43bf1783e82b admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.237226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327f99-9c72-4a21-900f-43bf1783e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.237788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327f99-9c72-4a21-900f-43bf1783e82b admin admin] PATH_INFO: `/v3/projects/3e2188659c44407ab63317709874bbf5/users/beefa3116b1c4a86b1c3a47c351e501e/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.264189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0327f99-9c72-4a21-900f-43bf1783e82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2188659c44407ab63317709874bbf5, user_id=beefa3116b1c4a86b1c3a47c351e501e, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.267974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0327f99-9c72-4a21-900f-43bf1783e82b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.319244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 979/1952] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:05 2022] PUT /identity/v3/projects/3e2188659c44407ab63317709874bbf5/users/beefa3116b1c4a86b1c3a47c351e501e/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:05.321329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80608f-8a22-4493-a106-a4fa6d614303 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.322148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80608f-8a22-4493-a106-a4fa6d614303 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.322563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80608f-8a22-4493-a106-a4fa6d614303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.361106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9d80608f-8a22-4493-a106-a4fa6d614303 None None] MFA Rules not processed for user `beefa3116b1c4a86b1c3a47c351e501e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:05.363548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9d80608f-8a22-4493-a106-a4fa6d614303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:05.415520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:05.491243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 974/1953] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:05.493284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0327f99-9c72-4a21-900f-43bf1783e82b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.577880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0327f99-9c72-4a21-900f-43bf1783e82b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.583081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc71e-b718-4ef1-94bb-0db842e86600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.583771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc71e-b718-4ef1-94bb-0db842e86600 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.584054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc71e-b718-4ef1-94bb-0db842e86600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.584332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc71e-b718-4ef1-94bb-0db842e86600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.585173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abc71e-b718-4ef1-94bb-0db842e86600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.591035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abc71e-b718-4ef1-94bb-0db842e86600 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.637607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 980/1954] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:05 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:05.640022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80608f-8a22-4493-a106-a4fa6d614303 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.651803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80608f-8a22-4493-a106-a4fa6d614303 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.731201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a85a1-7031-4ddf-8642-cf2c44039d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.732294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a85a1-7031-4ddf-8642-cf2c44039d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.732519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a85a1-7031-4ddf-8642-cf2c44039d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.732863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a85a1-7031-4ddf-8642-cf2c44039d00 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.733530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a85a1-7031-4ddf-8642-cf2c44039d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.736347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a85a1-7031-4ddf-8642-cf2c44039d00 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.761990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 975/1955] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:05 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:05.766266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc71e-b718-4ef1-94bb-0db842e86600 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.778947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc71e-b718-4ef1-94bb-0db842e86600 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.790550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b77b9-b05f-431c-9ebb-1a5d0d307202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.791802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b77b9-b05f-431c-9ebb-1a5d0d307202 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.791802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b77b9-b05f-431c-9ebb-1a5d0d307202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.791802 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b77b9-b05f-431c-9ebb-1a5d0d307202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.792546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b77b9-b05f-431c-9ebb-1a5d0d307202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.795440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b77b9-b05f-431c-9ebb-1a5d0d307202 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.808249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 981/1956] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:05.812770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a85a1-7031-4ddf-8642-cf2c44039d00 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.824301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a85a1-7031-4ddf-8642-cf2c44039d00 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.829547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493435-1437-4d23-94c3-a6632de83112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.830358 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493435-1437-4d23-94c3-a6632de83112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.830634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493435-1437-4d23-94c3-a6632de83112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.830961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8493435-1437-4d23-94c3-a6632de83112 admin admin] PATH_INFO: `/v3/projects/d5cfd6d4cb36409aa08a4145358934da/users/eaa95dd6cd2b46faa7a2026c701ae9bb/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.848250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493435-1437-4d23-94c3-a6632de83112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5cfd6d4cb36409aa08a4145358934da, user_id=eaa95dd6cd2b46faa7a2026c701ae9bb, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.851292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8493435-1437-4d23-94c3-a6632de83112 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.865255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 976/1957] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:05 2022] PUT /identity/v3/projects/d5cfd6d4cb36409aa08a4145358934da/users/eaa95dd6cd2b46faa7a2026c701ae9bb/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:05.869992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b77b9-b05f-431c-9ebb-1a5d0d307202 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.881326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b77b9-b05f-431c-9ebb-1a5d0d307202 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:05.911666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:05.958777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5846-c481-489d-97d6-501362fe8f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:05.959533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5846-c481-489d-97d6-501362fe8f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:05.960007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5846-c481-489d-97d6-501362fe8f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:05.960468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5846-c481-489d-97d6-501362fe8f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:05.961182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc5846-c481-489d-97d6-501362fe8f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:05.963370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc5846-c481-489d-97d6-501362fe8f04 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:05.976783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 982/1958] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:05.980915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493435-1437-4d23-94c3-a6632de83112 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:05.995377 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8493435-1437-4d23-94c3-a6632de83112 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:06.001441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:06.002162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:06.002444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:06.002719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] PATH_INFO: `/v3/projects/d5cfd6d4cb36409aa08a4145358934da/users/eaa95dd6cd2b46faa7a2026c701ae9bb/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:06.004962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5cfd6d4cb36409aa08a4145358934da, user_id=eaa95dd6cd2b46faa7a2026c701ae9bb, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:06.007878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:06.023514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 977/1959] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:05 2022] PUT /identity/v3/projects/d5cfd6d4cb36409aa08a4145358934da/users/eaa95dd6cd2b46faa7a2026c701ae9bb/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:06.035183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4105e6-7e9d-4fb8-b5e9-38cc0b582a4a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:06.035443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4105e6-7e9d-4fb8-b5e9-38cc0b582a4a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:06.035834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4105e6-7e9d-4fb8-b5e9-38cc0b582a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:06.083969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ce4105e6-7e9d-4fb8-b5e9-38cc0b582a4a None None] MFA Rules not processed for user `eaa95dd6cd2b46faa7a2026c701ae9bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:06.087697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ce4105e6-7e9d-4fb8-b5e9-38cc0b582a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:06.118081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:06.118081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:06.300496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 983/1960] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:06.314983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4105e6-7e9d-4fb8-b5e9-38cc0b582a4a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:06.319064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ce4105e6-7e9d-4fb8-b5e9-38cc0b582a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:06.405005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7587-cdb9-4a63-a532-380e26ba8649 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:06.428806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:06.431763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:06.432873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:06.433386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] PATH_INFO: `/v3/users/b6f9bef4a2db496188959dc3093a392d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:06.438549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f9bef4a2db496188959dc3093a392d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:06.454586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:06.522084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4105e6-7e9d-4fb8-b5e9-38cc0b582a4a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:06.529920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:06.538803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034aca-9c19-4657-bcdc-af531ee7822b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:06.539856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034aca-9c19-4657-bcdc-af531ee7822b service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:06.541161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034aca-9c19-4657-bcdc-af531ee7822b service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:06.543016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034aca-9c19-4657-bcdc-af531ee7822b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:06.567650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00034aca-9c19-4657-bcdc-af531ee7822b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:06.569448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00034aca-9c19-4657-bcdc-af531ee7822b service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:06.570285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f9bef4a2db496188959dc3093a392d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:06.571891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f9bef4a2db496188959dc3093a392d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:06.587219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f9bef4a2db496188959dc3093a392d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:06.587219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f9bef4a2db496188959dc3093a392d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:06.588963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 984/1961] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:06.605044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f9bef4a2db496188959dc3093a392d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:06.656885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 978/1962] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:06 2022] DELETE /identity/v3/users/b6f9bef4a2db496188959dc3093a392d => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:06.661155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de2cfc-98e7-460c-b936-63f6e3546102 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:06.661821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de2cfc-98e7-460c-b936-63f6e3546102 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:06.662298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de2cfc-98e7-460c-b936-63f6e3546102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:06.703848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-07de2cfc-98e7-460c-b936-63f6e3546102 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:06.703848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-07de2cfc-98e7-460c-b936-63f6e3546102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:06.747318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:06.750680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:06.786725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:06.806914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 985/1963] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:06.817734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de2cfc-98e7-460c-b936-63f6e3546102 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:06.819623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-07de2cfc-98e7-460c-b936-63f6e3546102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:06.833303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721bb77-0482-4066-b2ce-220f0201dd3c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:06.838501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:06.839481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:06.839945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:06.840337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:06.843005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:06.927403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de2cfc-98e7-460c-b936-63f6e3546102 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:06.935803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:06.937359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:06.948477 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 979/1964] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:06.949178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:06.950718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:06.955776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:06.955776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:06.974188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:06.976221 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:06.992372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 986/1965] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:07.391091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:07.398424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:07.415786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06866992-6b6f-4e06-952b-0c55ab155c07 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:07.445502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:07.446207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:07.446476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:07.446760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] PATH_INFO: `/v3/projects/f028b1d99ce64905940319325a7ee8cb` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:07.448217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f028b1d99ce64905940319325a7ee8cb)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:07.450168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:07.503154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f028b1d99ce64905940319325a7ee8cb', 'request_id': 'req-61a9030d-0f19-466e-8dbf-ce230c1fa863'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.507290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:07.512273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f028b1d99ce64905940319325a7ee8cb', 'request_id': 'req-61a9030d-0f19-466e-8dbf-ce230c1fa863'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.518984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:07.521166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:07.529060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f028b1d99ce64905940319325a7ee8cb', 'request_id': 'req-61a9030d-0f19-466e-8dbf-ce230c1fa863'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.542420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927af6f-eb14-4ecb-9064-afe09653fe06 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:07.545663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] The token cache is being invalidate because project f028b1d99ce64905940319325a7ee8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:07.546263 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.546833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61a9030d-0f19-466e-8dbf-ce230c1fa863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.549766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 980/1966] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:07 2022] DELETE /identity/v3/projects/f028b1d99ce64905940319325a7ee8cb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:07.557610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fde67f-99f8-4d5b-afe6-783ea6bc5fd5 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:07.557901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fde67f-99f8-4d5b-afe6-783ea6bc5fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:07.558175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fde67f-99f8-4d5b-afe6-783ea6bc5fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:07.580168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a7fde67f-99f8-4d5b-afe6-783ea6bc5fd5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:07.581701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a7fde67f-99f8-4d5b-afe6-783ea6bc5fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:07.606540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:07.607346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:07.607691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:07.608032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] PATH_INFO: `/v3/users/6933c0f9ca294db39e75fb9903ce9609` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:07.609256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6933c0f9ca294db39e75fb9903ce9609)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:07.611259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:07.677080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6933c0f9ca294db39e75fb9903ce9609'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.685139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 981/1967] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:07.690148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6933c0f9ca294db39e75fb9903ce9609'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.690925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6933c0f9ca294db39e75fb9903ce9609'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.691695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6933c0f9ca294db39e75fb9903ce9609'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.694639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a2f86-b253-4d45-819c-d8f1fd2b00d9 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:07.694999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a2f86-b253-4d45-819c-d8f1fd2b00d9 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:07.695501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a2f86-b253-4d45-819c-d8f1fd2b00d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:07.703289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d78510-4367-4dd5-9ce9-273246ff9ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6933c0f9ca294db39e75fb9903ce9609'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:07.739483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-903a2f86-b253-4d45-819c-d8f1fd2b00d9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:07.741631 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 987/1968] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:07 2022] DELETE /identity/v3/users/6933c0f9ca294db39e75fb9903ce9609 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:07.741846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-903a2f86-b253-4d45-819c-d8f1fd2b00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:07.745853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16320-25f6-425d-9d7d-7393495fa3a1 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:07.746120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16320-25f6-425d-9d7d-7393495fa3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:07.746408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa16320-25f6-425d-9d7d-7393495fa3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:07.781627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-baa16320-25f6-425d-9d7d-7393495fa3a1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:07.782958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-baa16320-25f6-425d-9d7d-7393495fa3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:07.798867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:07.901190 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 982/1969] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:07.912889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a2f86-b253-4d45-819c-d8f1fd2b00d9 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:07.935889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a2f86-b253-4d45-819c-d8f1fd2b00d9 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:07.951782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:07.955929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 988/1970] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:07.962094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:07.963227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:07.963842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa16320-25f6-425d-9d7d-7393495fa3a1 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:07.964793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:07.965737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-baa16320-25f6-425d-9d7d-7393495fa3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:07.967661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:07.968769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:07.976746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:08.005552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 983/1971] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:08.011380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:08.030205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafb9d0-d019-4065-9117-7051a06ff1ec admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:08.035454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed79a7c-cea5-4ac5-bac9-a7ec4f8857aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:08.036251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed79a7c-cea5-4ac5-bac9-a7ec4f8857aa admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.036542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed79a7c-cea5-4ac5-bac9-a7ec4f8857aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.036828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed79a7c-cea5-4ac5-bac9-a7ec4f8857aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.037483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed79a7c-cea5-4ac5-bac9-a7ec4f8857aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:08.039678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed79a7c-cea5-4ac5-bac9-a7ec4f8857aa admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:08.082230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 984/1972] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:08 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:08.088852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed79a7c-cea5-4ac5-bac9-a7ec4f8857aa admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:08.133105 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa16320-25f6-425d-9d7d-7393495fa3a1 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:08.171751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:08.190606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed79a7c-cea5-4ac5-bac9-a7ec4f8857aa admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:08.198666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:08.198666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.198945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.199040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.199695 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:08.202583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:08.235172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c28e9-234f-4648-b5e1-e28ac6416bbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:08.236157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c28e9-234f-4648-b5e1-e28ac6416bbd service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.236545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c28e9-234f-4648-b5e1-e28ac6416bbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.236919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 985/1973] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:08 2022] POST /identity/v3/users => generated 282 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:08.237054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c28e9-234f-4648-b5e1-e28ac6416bbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.241003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:08.243392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:08.255502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c28e9-234f-4648-b5e1-e28ac6416bbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:08.259497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c28e9-234f-4648-b5e1-e28ac6416bbd service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:08.260225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece8b9b-dde3-4a82-a694-099ce0390c7f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:08.265627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:08.266361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.266737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.267031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] PATH_INFO: `/v3/users/133287e1dceb4364b15fa285ac22bf7a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.268402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133287e1dceb4364b15fa285ac22bf7a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:08.270593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:08.278762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 989/1974] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:08.280034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c28e9-234f-4648-b5e1-e28ac6416bbd service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:08.294257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c28e9-234f-4648-b5e1-e28ac6416bbd service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:08.302774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbbf5b-8745-4a9f-bac5-03b5ecd79df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:08.303620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbbf5b-8745-4a9f-bac5-03b5ecd79df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.304796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbbf5b-8745-4a9f-bac5-03b5ecd79df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.306417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbbf5b-8745-4a9f-bac5-03b5ecd79df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.307953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbbf5b-8745-4a9f-bac5-03b5ecd79df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:08.311234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbbf5b-8745-4a9f-bac5-03b5ecd79df8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:08.325346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 990/1975] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:08.331062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbbf5b-8745-4a9f-bac5-03b5ecd79df8 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:08.357071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbbf5b-8745-4a9f-bac5-03b5ecd79df8 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:08.358147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133287e1dceb4364b15fa285ac22bf7a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:08.358998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133287e1dceb4364b15fa285ac22bf7a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:08.365974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:08.370145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.370145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.371207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.372448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:08.372959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133287e1dceb4364b15fa285ac22bf7a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:08.374395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:08.375498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133287e1dceb4364b15fa285ac22bf7a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:08.390841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6b83cdd4-701a-47ec-9ec8-fe4243a53c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133287e1dceb4364b15fa285ac22bf7a'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:08.394865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 991/1976] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:08.396526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:08.401758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:08.437583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 986/1977] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:08 2022] DELETE /identity/v3/users/133287e1dceb4364b15fa285ac22bf7a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:08.443662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014ec8b-3d7a-4f3f-b7bb-b227c32ec569 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.444551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014ec8b-3d7a-4f3f-b7bb-b227c32ec569 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.445035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884dab6-323d-4e1b-9502-edd0f6fcd652 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:08.445905 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014ec8b-3d7a-4f3f-b7bb-b227c32ec569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.473705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7014ec8b-3d7a-4f3f-b7bb-b227c32ec569 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:08.475187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7014ec8b-3d7a-4f3f-b7bb-b227c32ec569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:08.576349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:08.590166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b02e24-ffd9-4437-b4aa-af3cf0feb2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:08.591363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b02e24-ffd9-4437-b4aa-af3cf0feb2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.591864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b02e24-ffd9-4437-b4aa-af3cf0feb2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.592669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b02e24-ffd9-4437-b4aa-af3cf0feb2b0 admin admin] PATH_INFO: `/v3/projects/a5d860929bb3431097d97d22ebd867ef/users/b1b8ef6601cd48af803cb18b3b386fce/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.614889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b02e24-ffd9-4437-b4aa-af3cf0feb2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d860929bb3431097d97d22ebd867ef, user_id=b1b8ef6601cd48af803cb18b3b386fce, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:08.620458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b02e24-ffd9-4437-b4aa-af3cf0feb2b0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:08.663692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 992/1978] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:08 2022] PUT /identity/v3/projects/a5d860929bb3431097d97d22ebd867ef/users/b1b8ef6601cd48af803cb18b3b386fce/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:08.667404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e1dac-4c82-41f5-aa6e-fd7872d82476 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:08.667703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e1dac-4c82-41f5-aa6e-fd7872d82476 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:08.668018 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e1dac-4c82-41f5-aa6e-fd7872d82476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:08.717248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 987/1979] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:08.747741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014ec8b-3d7a-4f3f-b7bb-b227c32ec569 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:08.752815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7014ec8b-3d7a-4f3f-b7bb-b227c32ec569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:08.770034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-505e1dac-4c82-41f5-aa6e-fd7872d82476 None None] MFA Rules not processed for user `b1b8ef6601cd48af803cb18b3b386fce`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:08.772754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-505e1dac-4c82-41f5-aa6e-fd7872d82476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:08.899314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 993/1980] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:08.899314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e1dac-4c82-41f5-aa6e-fd7872d82476 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:08.899314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-505e1dac-4c82-41f5-aa6e-fd7872d82476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:08.912614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014ec8b-3d7a-4f3f-b7bb-b227c32ec569 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:08.918260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:09.034004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e1dac-4c82-41f5-aa6e-fd7872d82476 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:09.050256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:09.051387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:09.051953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:09.052503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] PATH_INFO: `/v3/projects/21f14c4352b94c8ba4895d84a6180cd4` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:09.057100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f14c4352b94c8ba4895d84a6180cd4)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:09.061646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:09.064812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:09.072281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:09.072809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:09.073478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:09.113852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:09.115790 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:09.149064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 988/1981] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:09.151562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:09.155293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:09.215293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f14c4352b94c8ba4895d84a6180cd4', 'request_id': 'req-74df91e8-90ce-4ade-ac71-203e48c384a5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.234911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f14c4352b94c8ba4895d84a6180cd4', 'request_id': 'req-74df91e8-90ce-4ade-ac71-203e48c384a5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.255945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f14c4352b94c8ba4895d84a6180cd4', 'request_id': 'req-74df91e8-90ce-4ade-ac71-203e48c384a5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.265733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206efbfb-74b9-4ed9-8f52-b5bf5f362cf9 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:09.272996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:09.293493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] The token cache is being invalidate because project 21f14c4352b94c8ba4895d84a6180cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:09.295362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.296479 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.302665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 994/1982] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:08 2022] DELETE /identity/v3/projects/21f14c4352b94c8ba4895d84a6180cd4 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:09.305969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:09.310094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:09.382250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:09.384723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:09.385456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:09.386197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:09.391016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:09.441678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df91e8-90ce-4ade-ac71-203e48c384a5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:09.448379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:09.449168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:09.449454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:09.449814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] PATH_INFO: `/v3/users/302889bc0bbe4456aa4da27fa472de38` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:09.451232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] RBAC: Authorizing `identity:delete_user(user_id=302889bc0bbe4456aa4da27fa472de38)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:09.453274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:09.482249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:09.483734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:09.497826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 989/1983] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:09.522372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302889bc0bbe4456aa4da27fa472de38'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.533042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302889bc0bbe4456aa4da27fa472de38'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.534129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302889bc0bbe4456aa4da27fa472de38'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.535183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302889bc0bbe4456aa4da27fa472de38'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.546942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302889bc0bbe4456aa4da27fa472de38'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:09.590439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 995/1984] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:09 2022] DELETE /identity/v3/users/302889bc0bbe4456aa4da27fa472de38 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:09.777626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:09.779279 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:09.814254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c60dc-d0ea-48f8-991e-2e1ead4dd9c6 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:09.860180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:09.981169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:09.982427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:09.982772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:09.983059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] PATH_INFO: `/v3/projects/9b983005f7e64429b6d7a387e49bcdb2` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:09.986066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b983005f7e64429b6d7a387e49bcdb2)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:09.987541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:10.006508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.011217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.033268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d70b03-7cec-4e59-9538-ce0de67d738f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:10.052731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:10.053923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.054615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.056764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] PATH_INFO: `/v3/users/beefa3116b1c4a86b1c3a47c351e501e` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.070567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beefa3116b1c4a86b1c3a47c351e501e)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:10.073320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:10.098638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b983005f7e64429b6d7a387e49bcdb2', 'request_id': 'req-9e39b737-42bf-4558-9300-99a9117166c0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.125775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b983005f7e64429b6d7a387e49bcdb2', 'request_id': 'req-9e39b737-42bf-4558-9300-99a9117166c0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.142221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b983005f7e64429b6d7a387e49bcdb2', 'request_id': 'req-9e39b737-42bf-4558-9300-99a9117166c0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.192051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] The token cache is being invalidate because project 9b983005f7e64429b6d7a387e49bcdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:10.192614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.193338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9e39b737-42bf-4558-9300-99a9117166c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.195218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 990/1985] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:09 2022] DELETE /identity/v3/projects/9b983005f7e64429b6d7a387e49bcdb2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:10.201210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a7e3-3fed-4861-afc0-d9e743c9af52 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.201710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a7e3-3fed-4861-afc0-d9e743c9af52 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.202133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a7e3-3fed-4861-afc0-d9e743c9af52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.206281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beefa3116b1c4a86b1c3a47c351e501e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.221347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beefa3116b1c4a86b1c3a47c351e501e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.224312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beefa3116b1c4a86b1c3a47c351e501e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.225189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beefa3116b1c4a86b1c3a47c351e501e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.227576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2959a7e3-3fed-4861-afc0-d9e743c9af52 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:10.228841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2959a7e3-3fed-4861-afc0-d9e743c9af52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.239004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beefa3116b1c4a86b1c3a47c351e501e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.246798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:10.270834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 996/1986] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:10 2022] DELETE /identity/v3/users/beefa3116b1c4a86b1c3a47c351e501e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:10.271662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.273084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.325766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 991/1987] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:10.327210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1cd9e-316d-46bf-931a-1d229e427776 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.327509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1cd9e-316d-46bf-931a-1d229e427776 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.327932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1cd9e-316d-46bf-931a-1d229e427776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.352946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-25c1cd9e-316d-46bf-931a-1d229e427776 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:10.355077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-25c1cd9e-316d-46bf-931a-1d229e427776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.394161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940fc7-2eec-4d62-9f88-2147e25c76b5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:10.409768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:10.410643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.410878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.411222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] PATH_INFO: `/v3/projects/6ddd59ce246d45c988b86de150368e1e` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.413775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ddd59ce246d45c988b86de150368e1e)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:10.415981 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:10.421088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:10.462679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 992/1988] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:10.464339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bcf26-e518-4025-9828-04b9ddf2e838 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.464636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bcf26-e518-4025-9828-04b9ddf2e838 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.465094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bcf26-e518-4025-9828-04b9ddf2e838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.500821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8d4bcf26-e518-4025-9828-04b9ddf2e838 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:10.502283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8d4bcf26-e518-4025-9828-04b9ddf2e838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.519515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ddd59ce246d45c988b86de150368e1e', 'request_id': 'req-91c3c0e8-6520-435b-b192-c7316c522f1c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.537332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ddd59ce246d45c988b86de150368e1e', 'request_id': 'req-91c3c0e8-6520-435b-b192-c7316c522f1c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.547014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ddd59ce246d45c988b86de150368e1e', 'request_id': 'req-91c3c0e8-6520-435b-b192-c7316c522f1c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.568651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] The token cache is being invalidate because project 6ddd59ce246d45c988b86de150368e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:10.569052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.570057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:10.572728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 997/1989] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:10 2022] DELETE /identity/v3/projects/6ddd59ce246d45c988b86de150368e1e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:10.576477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.578507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.593309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 993/1990] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:10.594652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37080-3594-4b5b-803f-1c556050d559 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.594951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37080-3594-4b5b-803f-1c556050d559 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.595235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37080-3594-4b5b-803f-1c556050d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.626364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-29b37080-3594-4b5b-803f-1c556050d559 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:10.627991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-29b37080-3594-4b5b-803f-1c556050d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.642378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 994/1991] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:10.644132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b37080-3594-4b5b-803f-1c556050d559 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.656873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b37080-3594-4b5b-803f-1c556050d559 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:10.663504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e3e6a-5269-43a9-80ce-3103250e625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:10.664014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e3e6a-5269-43a9-80ce-3103250e625d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.664315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e3e6a-5269-43a9-80ce-3103250e625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.664715 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e3e6a-5269-43a9-80ce-3103250e625d admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.665293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e3e6a-5269-43a9-80ce-3103250e625d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:10.665635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e3e6a-5269-43a9-80ce-3103250e625d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:10.667628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e3e6a-5269-43a9-80ce-3103250e625d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:10.691446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 995/1992] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:10.691446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b5c2-751a-4be9-9495-cc5e56ed7510 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.691446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b5c2-751a-4be9-9495-cc5e56ed7510 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.691446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b5c2-751a-4be9-9495-cc5e56ed7510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.692108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3c0e8-6520-435b-b192-c7316c522f1c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:10.693138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:10.693814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.694214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.694574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.701574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.729652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a2b5b5c2-751a-4be9-9495-cc5e56ed7510 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:10.731405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a2b5b5c2-751a-4be9-9495-cc5e56ed7510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:10.734647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:10.736368 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:10.741554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 996/1993] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:10.742744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5b5c2-751a-4be9-9495-cc5e56ed7510 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.751029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 998/1994] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:10.751984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.754601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5b5c2-751a-4be9-9495-cc5e56ed7510 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:10.762481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f045937-026a-4b06-bfc6-169fea475620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:10.762481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f045937-026a-4b06-bfc6-169fea475620 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.762944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f045937-026a-4b06-bfc6-169fea475620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.763098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f045937-026a-4b06-bfc6-169fea475620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.763374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98bc1-799a-4e1e-97c3-0b97ea2b471b service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:10.763707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f045937-026a-4b06-bfc6-169fea475620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:10.765794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f045937-026a-4b06-bfc6-169fea475620 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:10.769218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:10.769879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.770165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.770444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.771349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:10.771586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:10.773360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:10.786852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 999/1995] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:10.794827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.818050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 997/1996] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:10.824913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d964a6-437b-4682-97ba-3a2c6cd3109b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:10.826031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f045937-026a-4b06-bfc6-169fea475620 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.832818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:10.921821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693c38-bbde-459a-b828-0a24150bef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:10.922524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693c38-bbde-459a-b828-0a24150bef73 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:10.922833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693c38-bbde-459a-b828-0a24150bef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:10.923110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693c38-bbde-459a-b828-0a24150bef73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:10.923906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25693c38-bbde-459a-b828-0a24150bef73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:10.931426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25693c38-bbde-459a-b828-0a24150bef73 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:10.969255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1000/1997] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:10.973986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693c38-bbde-459a-b828-0a24150bef73 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:10.975411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f045937-026a-4b06-bfc6-169fea475620 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.050136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:11.055553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693c38-bbde-459a-b828-0a24150bef73 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.061055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db726f-ddbd-4926-830d-e96a3b925082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.061806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db726f-ddbd-4926-830d-e96a3b925082 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.062112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772a3c3-568a-45fb-840b-8ed4c3544f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.062239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db726f-ddbd-4926-830d-e96a3b925082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.062475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db726f-ddbd-4926-830d-e96a3b925082 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.063135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db726f-ddbd-4926-830d-e96a3b925082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.063292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772a3c3-568a-45fb-840b-8ed4c3544f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.063455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772a3c3-568a-45fb-840b-8ed4c3544f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.063689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772a3c3-568a-45fb-840b-8ed4c3544f17 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.064354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772a3c3-568a-45fb-840b-8ed4c3544f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.065106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db726f-ddbd-4926-830d-e96a3b925082 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.066302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772a3c3-568a-45fb-840b-8ed4c3544f17 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.095645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 998/1998] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:11.097801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db726f-ddbd-4926-830d-e96a3b925082 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.111971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db726f-ddbd-4926-830d-e96a3b925082 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.118763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1001/1999] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:10 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:11.120164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772a3c3-568a-45fb-840b-8ed4c3544f17 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.126648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.129338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.129733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.130452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.131164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.136491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.137290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772a3c3-568a-45fb-840b-8ed4c3544f17 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.172293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 999/2000] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:11.173189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.174987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:11.190709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab21a58-6e7f-4066-846a-dfe461f6a3cd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.194585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30989a-7db6-4494-b492-a7c3219a265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.197340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.198049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30989a-7db6-4494-b492-a7c3219a265e admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.198271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.198824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.199208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] PATH_INFO: `/v3/projects/3e2188659c44407ab63317709874bbf5` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.200043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30989a-7db6-4494-b492-a7c3219a265e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.200491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30989a-7db6-4494-b492-a7c3219a265e admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.200812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2188659c44407ab63317709874bbf5)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.201713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30989a-7db6-4494-b492-a7c3219a265e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.204205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.209507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30989a-7db6-4494-b492-a7c3219a265e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.256591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1002/2001] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:11.257589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30989a-7db6-4494-b492-a7c3219a265e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.293760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30989a-7db6-4494-b492-a7c3219a265e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.293868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2188659c44407ab63317709874bbf5', 'request_id': 'req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.313874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2188659c44407ab63317709874bbf5', 'request_id': 'req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.326937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2188659c44407ab63317709874bbf5', 'request_id': 'req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.344734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] The token cache is being invalidate because project 3e2188659c44407ab63317709874bbf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:11.345293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.346613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.351720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1000/2002] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:11 2022] DELETE /identity/v3/projects/3e2188659c44407ab63317709874bbf5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:11.351720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.355063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:11.409770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.409770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.409770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.409770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.410757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.412163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.429103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1003/2003] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:11.429103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.429103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:11.443699 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc9d14-9525-40be-8d31-f76104b90eac admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.450903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.451736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.452308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.452684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] PATH_INFO: `/v3/users/eaa95dd6cd2b46faa7a2026c701ae9bb` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.454649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa95dd6cd2b46faa7a2026c701ae9bb)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.457395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.459456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:11.506705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab5193-7ec4-4649-a9d5-2709b4a2a0cc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.515604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.515604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.516013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.516294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.517926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.520021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.537969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1001/2004] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:11.537969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.538276 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:11.557907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218271b6-32a8-4852-af3c-5cc50c091327 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.561685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa95dd6cd2b46faa7a2026c701ae9bb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.583665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921f9aa-9fc7-4a51-ba85-95d981493b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.584614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921f9aa-9fc7-4a51-ba85-95d981493b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.585777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa95dd6cd2b46faa7a2026c701ae9bb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.586534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa95dd6cd2b46faa7a2026c701ae9bb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.587151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921f9aa-9fc7-4a51-ba85-95d981493b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.587579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa95dd6cd2b46faa7a2026c701ae9bb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.589315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921f9aa-9fc7-4a51-ba85-95d981493b85 admin admin] PATH_INFO: `/v3/projects/08b66e624374469b876a10e7c89f3de6/users/f7bfaa57173c4ef085e517805d8e5e1b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.599452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa95dd6cd2b46faa7a2026c701ae9bb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:11.620541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921f9aa-9fc7-4a51-ba85-95d981493b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b66e624374469b876a10e7c89f3de6, user_id=f7bfaa57173c4ef085e517805d8e5e1b, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.624255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921f9aa-9fc7-4a51-ba85-95d981493b85 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.625963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1004/2005] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:11 2022] DELETE /identity/v3/users/eaa95dd6cd2b46faa7a2026c701ae9bb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:11.627017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.636141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:11.650410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1002/2006] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:11 2022] PUT /identity/v3/projects/08b66e624374469b876a10e7c89f3de6/users/f7bfaa57173c4ef085e517805d8e5e1b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:11.652865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40914db-26f4-4f0f-a2bf-955bb3dd5105 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.653297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40914db-26f4-4f0f-a2bf-955bb3dd5105 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.653702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40914db-26f4-4f0f-a2bf-955bb3dd5105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.676866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e40914db-26f4-4f0f-a2bf-955bb3dd5105 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:11.678515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e40914db-26f4-4f0f-a2bf-955bb3dd5105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:11.721554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:11.795924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4250a-b341-4c0d-b59c-8ee6ba8b4aa9 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:11.842992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1003/2007] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:11.896307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40914db-26f4-4f0f-a2bf-955bb3dd5105 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:11.899264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e40914db-26f4-4f0f-a2bf-955bb3dd5105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:11.901505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d4cdf-e1a4-44a6-9ed4-356f2db3d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:11.904482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4cdf-e1a4-44a6-9ed4-356f2db3d241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:11.905064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4cdf-e1a4-44a6-9ed4-356f2db3d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:11.905664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d4cdf-e1a4-44a6-9ed4-356f2db3d241 admin admin] PATH_INFO: `/v3/projects/265c2272fbd34c46993a9f4ec093e372/users/4a9814d78dcc45fd8a9cf63cb0f54ea6/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:11.946546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d4cdf-e1a4-44a6-9ed4-356f2db3d241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=265c2272fbd34c46993a9f4ec093e372, user_id=4a9814d78dcc45fd8a9cf63cb0f54ea6, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:11.951707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d4cdf-e1a4-44a6-9ed4-356f2db3d241 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:11.998393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1005/2008] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:11 2022] PUT /identity/v3/projects/265c2272fbd34c46993a9f4ec093e372/users/4a9814d78dcc45fd8a9cf63cb0f54ea6/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:12.019522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da79c0c-1892-4d31-a18f-5833f20aa08b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:12.020000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da79c0c-1892-4d31-a18f-5833f20aa08b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:12.020629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da79c0c-1892-4d31-a18f-5833f20aa08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:12.071740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:12.100272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6da79c0c-1892-4d31-a18f-5833f20aa08b None None] MFA Rules not processed for user `4a9814d78dcc45fd8a9cf63cb0f54ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:12.102849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6da79c0c-1892-4d31-a18f-5833f20aa08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:12.176052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40914db-26f4-4f0f-a2bf-955bb3dd5105 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:12.279515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1006/2009] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:12.286319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da79c0c-1892-4d31-a18f-5833f20aa08b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:12.330425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ddd6-9908-48ce-be4e-eafe75943879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:12.331062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ddd6-9908-48ce-be4e-eafe75943879 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:12.331338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ddd6-9908-48ce-be4e-eafe75943879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:12.331612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954ddd6-9908-48ce-be4e-eafe75943879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:12.430154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da79c0c-1892-4d31-a18f-5833f20aa08b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:12.435452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:12.436543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:12.436648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:12.436855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:12.437554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:12.439649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:12.460635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954ddd6-9908-48ce-be4e-eafe75943879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:12.466076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954ddd6-9908-48ce-be4e-eafe75943879 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:12.480274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1007/2010] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:12 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:12.481128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:12.484834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:12.485088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1004/2011] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:12.486174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ddd6-9908-48ce-be4e-eafe75943879 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:12.499680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954ddd6-9908-48ce-be4e-eafe75943879 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:12.547963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:12.620906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea96f0a-3081-462e-9175-f662902fe0e0 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:12.630780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:12.631290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:12.631758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:12.632223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] PATH_INFO: `/v3/projects/d5cfd6d4cb36409aa08a4145358934da` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:12.634097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274b698-0c50-4dbd-81a2-f769db882cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:12.634891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5cfd6d4cb36409aa08a4145358934da)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:12.638288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:12.639286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b698-0c50-4dbd-81a2-f769db882cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:12.639920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b698-0c50-4dbd-81a2-f769db882cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:12.640734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274b698-0c50-4dbd-81a2-f769db882cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:12.643626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b698-0c50-4dbd-81a2-f769db882cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:12.654298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274b698-0c50-4dbd-81a2-f769db882cb2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:12.690099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:12.709629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1005/2012] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:12 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:12.710607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274b698-0c50-4dbd-81a2-f769db882cb2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:12.728439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5cfd6d4cb36409aa08a4145358934da', 'request_id': 'req-938c0697-d4b0-4015-a4d7-cb3733725252'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:12.729057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274b698-0c50-4dbd-81a2-f769db882cb2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:12.744266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5cfd6d4cb36409aa08a4145358934da', 'request_id': 'req-938c0697-d4b0-4015-a4d7-cb3733725252'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:12.752302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5cfd6d4cb36409aa08a4145358934da', 'request_id': 'req-938c0697-d4b0-4015-a4d7-cb3733725252'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:12.770382 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] The token cache is being invalidate because project d5cfd6d4cb36409aa08a4145358934da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:12.770707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:12.771376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-938c0697-d4b0-4015-a4d7-cb3733725252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:12.773560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1008/2013] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:12 2022] DELETE /identity/v3/projects/d5cfd6d4cb36409aa08a4145358934da => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:12.780147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737e9d-0b2e-445e-8e33-80fa44a8610a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:12.780947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737e9d-0b2e-445e-8e33-80fa44a8610a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:12.781799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737e9d-0b2e-445e-8e33-80fa44a8610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:12.818302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-04737e9d-0b2e-445e-8e33-80fa44a8610a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:12.825393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-04737e9d-0b2e-445e-8e33-80fa44a8610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:12.840911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:12.842019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:12.842469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:12.843010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:12.844698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:12.846666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:12.866945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1006/2014] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:12.867097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:12.869594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:12.885719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9276cb5-6a39-4153-9e3b-68ef5ceee6a3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:12.894306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcf359-0270-4ff1-a3bb-513114144252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:12.896957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcf359-0270-4ff1-a3bb-513114144252 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:12.898144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcf359-0270-4ff1-a3bb-513114144252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:12.899233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdcf359-0270-4ff1-a3bb-513114144252 admin admin] PATH_INFO: `/v3/projects/c86bbfb51cd94a58b432184b7b4bf478/users/4bf69d2a66b943e893f7e07409728cf1/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:12.934496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcf359-0270-4ff1-a3bb-513114144252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86bbfb51cd94a58b432184b7b4bf478, user_id=4bf69d2a66b943e893f7e07409728cf1, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:12.937378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdcf359-0270-4ff1-a3bb-513114144252 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:12.964106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1007/2015] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:12 2022] PUT /identity/v3/projects/c86bbfb51cd94a58b432184b7b4bf478/users/4bf69d2a66b943e893f7e07409728cf1/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:12.970556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcf359-0270-4ff1-a3bb-513114144252 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:12.993817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1009/2016] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:13.002591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ccdc-10a6-482b-a9a6-dc2de3a39d1b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.002882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ccdc-10a6-482b-a9a6-dc2de3a39d1b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.003538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16ccdc-10a6-482b-a9a6-dc2de3a39d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.032357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5e16ccdc-10a6-482b-a9a6-dc2de3a39d1b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:13.033656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5e16ccdc-10a6-482b-a9a6-dc2de3a39d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:13.076253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdcf359-0270-4ff1-a3bb-513114144252 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.082720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875b51-6917-4a8a-aa3e-61bb3de8a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.083999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875b51-6917-4a8a-aa3e-61bb3de8a440 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.085383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875b51-6917-4a8a-aa3e-61bb3de8a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.085903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875b51-6917-4a8a-aa3e-61bb3de8a440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.086978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be875b51-6917-4a8a-aa3e-61bb3de8a440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.089028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be875b51-6917-4a8a-aa3e-61bb3de8a440 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.106545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1008/2017] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:13.111650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875b51-6917-4a8a-aa3e-61bb3de8a440 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:13.124571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875b51-6917-4a8a-aa3e-61bb3de8a440 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.160611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aad38-bd7a-41e2-8bb2-17c2a54f102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.167991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad38-bd7a-41e2-8bb2-17c2a54f102a admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.168345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad38-bd7a-41e2-8bb2-17c2a54f102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.168638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aad38-bd7a-41e2-8bb2-17c2a54f102a admin admin] PATH_INFO: `/v3/projects/c86bbfb51cd94a58b432184b7b4bf478/users/4bf69d2a66b943e893f7e07409728cf1/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.172550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1010/2018] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:13.178880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16ccdc-10a6-482b-a9a6-dc2de3a39d1b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:13.185571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aad38-bd7a-41e2-8bb2-17c2a54f102a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86bbfb51cd94a58b432184b7b4bf478, user_id=4bf69d2a66b943e893f7e07409728cf1, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.190324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aad38-bd7a-41e2-8bb2-17c2a54f102a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.228824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16ccdc-10a6-482b-a9a6-dc2de3a39d1b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.241829 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1009/2019] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:13 2022] PUT /identity/v3/projects/c86bbfb51cd94a58b432184b7b4bf478/users/4bf69d2a66b943e893f7e07409728cf1/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:13.255100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8464-e1ec-4178-ad0a-6481e0db6b48 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.255547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8464-e1ec-4178-ad0a-6481e0db6b48 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.255839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c8464-e1ec-4178-ad0a-6481e0db6b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.339914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c69c8464-e1ec-4178-ad0a-6481e0db6b48 None None] MFA Rules not processed for user `4bf69d2a66b943e893f7e07409728cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:13.342334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c69c8464-e1ec-4178-ad0a-6481e0db6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:13.351637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:13.403179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:13.415135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.417257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.417985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.418371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.420078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:13.421626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.424744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.447076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1011/2020] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:13.447076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:13.463482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ceae44-481b-4aee-bb59-354958c06b5f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.491650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501c305-28c2-4673-bf60-9f3fb3279d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.494701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c305-28c2-4673-bf60-9f3fb3279d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.496647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c305-28c2-4673-bf60-9f3fb3279d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.496943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c305-28c2-4673-bf60-9f3fb3279d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.498106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501c305-28c2-4673-bf60-9f3fb3279d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.502814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501c305-28c2-4673-bf60-9f3fb3279d17 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.516348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1010/2021] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:13.536929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8464-e1ec-4178-ad0a-6481e0db6b48 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:13.541965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c69c8464-e1ec-4178-ad0a-6481e0db6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:13.581355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1012/2022] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:13 2022] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:13.586983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501c305-28c2-4673-bf60-9f3fb3279d17 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:13.652558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c8464-e1ec-4178-ad0a-6481e0db6b48 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.682737 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501c305-28c2-4673-bf60-9f3fb3279d17 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.690195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb3680-b547-4743-8122-6d6ae00bcd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.691265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb3680-b547-4743-8122-6d6ae00bcd95 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.691839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb3680-b547-4743-8122-6d6ae00bcd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.692327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb3680-b547-4743-8122-6d6ae00bcd95 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.693290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb3680-b547-4743-8122-6d6ae00bcd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.696424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb3680-b547-4743-8122-6d6ae00bcd95 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.732935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1013/2023] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:13 2022] POST /identity/v3/users => generated 305 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:13.734470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb3680-b547-4743-8122-6d6ae00bcd95 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:13.749397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb3680-b547-4743-8122-6d6ae00bcd95 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.756104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f43a29-c4a8-4c73-b27d-1902a8433ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.757450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43a29-c4a8-4c73-b27d-1902a8433ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.757989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43a29-c4a8-4c73-b27d-1902a8433ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.759728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f43a29-c4a8-4c73-b27d-1902a8433ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.760720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f43a29-c4a8-4c73-b27d-1902a8433ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.762733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f43a29-c4a8-4c73-b27d-1902a8433ad9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.778226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1014/2024] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:13.782390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03505-b655-4e18-8b7c-3a884d13ed2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.783113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03505-b655-4e18-8b7c-3a884d13ed2d service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.783450 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03505-b655-4e18-8b7c-3a884d13ed2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.783745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03505-b655-4e18-8b7c-3a884d13ed2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.783851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f43a29-c4a8-4c73-b27d-1902a8433ad9 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:13.808390 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f43a29-c4a8-4c73-b27d-1902a8433ad9 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.825200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c16a9a-8883-44ba-8b20-98245faf804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.826059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16a9a-8883-44ba-8b20-98245faf804d admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.826347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16a9a-8883-44ba-8b20-98245faf804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.826854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16a9a-8883-44ba-8b20-98245faf804d admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.827528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c16a9a-8883-44ba-8b20-98245faf804d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.829339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c16a9a-8883-44ba-8b20-98245faf804d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.856468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1015/2025] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:13.875657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c16a9a-8883-44ba-8b20-98245faf804d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:13.892482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c16a9a-8883-44ba-8b20-98245faf804d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:13.902079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73999ef7-1446-413f-835c-33b608b32e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:13.904082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73999ef7-1446-413f-835c-33b608b32e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.904082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73999ef7-1446-413f-835c-33b608b32e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.904082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73999ef7-1446-413f-835c-33b608b32e64 admin admin] PATH_INFO: `/v3/projects/faabfa4b36d44834a1e5483b61c6165f/users/a9d4ec1e69324fc09962b53fb1a5806e/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:13.932146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73999ef7-1446-413f-835c-33b608b32e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faabfa4b36d44834a1e5483b61c6165f, user_id=a9d4ec1e69324fc09962b53fb1a5806e, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.935170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73999ef7-1446-413f-835c-33b608b32e64 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.940197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c03505-b655-4e18-8b7c-3a884d13ed2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:13.943710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c03505-b655-4e18-8b7c-3a884d13ed2d service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:13.955625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1016/2026] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:13 2022] PUT /identity/v3/projects/faabfa4b36d44834a1e5483b61c6165f/users/a9d4ec1e69324fc09962b53fb1a5806e/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:13.962842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1011/2027] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:13.975764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0fe0-1b6e-4388-b365-300a97edd409 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:13.977402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0fe0-1b6e-4388-b365-300a97edd409 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:13.978291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d0fe0-1b6e-4388-b365-300a97edd409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.072298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6b1d0fe0-1b6e-4388-b365-300a97edd409 None None] MFA Rules not processed for user `a9d4ec1e69324fc09962b53fb1a5806e`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:14.073666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6b1d0fe0-1b6e-4388-b365-300a97edd409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:14.099964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03505-b655-4e18-8b7c-3a884d13ed2d service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:14.112440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03505-b655-4e18-8b7c-3a884d13ed2d service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:14.117322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:14.179147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:14.191876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1017/2028] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:13 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:14.192947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d0fe0-1b6e-4388-b365-300a97edd409 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:14.207793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:14.209256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:14.209970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:14.210481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.213743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:14.314463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d0fe0-1b6e-4388-b365-300a97edd409 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:14.319594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:14.320200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b978b2f-649d-4ee3-85c5-f1938eb0fefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:14.321116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978b2f-649d-4ee3-85c5-f1938eb0fefa admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:14.321271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:14.321601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978b2f-649d-4ee3-85c5-f1938eb0fefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:14.322021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b978b2f-649d-4ee3-85c5-f1938eb0fefa admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.323049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b978b2f-649d-4ee3-85c5-f1938eb0fefa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:14.326200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b978b2f-649d-4ee3-85c5-f1938eb0fefa admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:14.334743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1012/2029] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:14.388417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1018/2030] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:14 2022] POST /identity/v3/projects => generated 409 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:14.393370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:14.409368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee90158-ef35-4edc-add0-03b3f4c07e4e service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:14.498438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b64890-8227-4a00-af2e-a703eae31ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:14.499353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b64890-8227-4a00-af2e-a703eae31ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:14.499883 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b64890-8227-4a00-af2e-a703eae31ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:14.500339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b64890-8227-4a00-af2e-a703eae31ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.501186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b64890-8227-4a00-af2e-a703eae31ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:14.503543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b64890-8227-4a00-af2e-a703eae31ec9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:14.530500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1013/2031] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:14 2022] POST /identity/v3/users => generated 311 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:14.534809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b978b2f-649d-4ee3-85c5-f1938eb0fefa admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:14.547141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b978b2f-649d-4ee3-85c5-f1938eb0fefa admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:14.553167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a5af6-9360-4a57-8717-6f9bfa941e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:14.553852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5af6-9360-4a57-8717-6f9bfa941e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:14.554182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5af6-9360-4a57-8717-6f9bfa941e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:14.554642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5af6-9360-4a57-8717-6f9bfa941e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.555383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a5af6-9360-4a57-8717-6f9bfa941e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:14.557130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a5af6-9360-4a57-8717-6f9bfa941e1e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:14.570009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1019/2032] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:14.574654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b64890-8227-4a00-af2e-a703eae31ec9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:14.588224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b64890-8227-4a00-af2e-a703eae31ec9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:14.596813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b004ca-6232-44a8-a4d2-d5de22496894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:14.597705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b004ca-6232-44a8-a4d2-d5de22496894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:14.598059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b004ca-6232-44a8-a4d2-d5de22496894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:14.598412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b004ca-6232-44a8-a4d2-d5de22496894 admin admin] PATH_INFO: `/v3/projects/b834a40902754a31a7bc60c0e192001c/users/6c23705d5c2e42de8dd0f0b5c5d1b10f/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.621310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b004ca-6232-44a8-a4d2-d5de22496894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b834a40902754a31a7bc60c0e192001c, user_id=6c23705d5c2e42de8dd0f0b5c5d1b10f, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:14.626058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b004ca-6232-44a8-a4d2-d5de22496894 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:14.661492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1014/2033] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:14 2022] PUT /identity/v3/projects/b834a40902754a31a7bc60c0e192001c/users/6c23705d5c2e42de8dd0f0b5c5d1b10f/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:14.668505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a5af6-9360-4a57-8717-6f9bfa941e1e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:14.684317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a5af6-9360-4a57-8717-6f9bfa941e1e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:14.835819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159627f-8d8d-47b6-84f8-10957ab8d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:14.837149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159627f-8d8d-47b6-84f8-10957ab8d3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:14.837726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159627f-8d8d-47b6-84f8-10957ab8d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:14.838274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159627f-8d8d-47b6-84f8-10957ab8d3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.839474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159627f-8d8d-47b6-84f8-10957ab8d3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:14.842753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159627f-8d8d-47b6-84f8-10957ab8d3b9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:14.866934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1020/2034] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:14.871328 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b004ca-6232-44a8-a4d2-d5de22496894 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:14.906923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b004ca-6232-44a8-a4d2-d5de22496894 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:14.916290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:14.918090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:14.918679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:14.919303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] PATH_INFO: `/v3/projects/b834a40902754a31a7bc60c0e192001c/users/6c23705d5c2e42de8dd0f0b5c5d1b10f/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.923717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b834a40902754a31a7bc60c0e192001c, user_id=6c23705d5c2e42de8dd0f0b5c5d1b10f, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:14.931353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:14.949175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1015/2035] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:14 2022] PUT /identity/v3/projects/b834a40902754a31a7bc60c0e192001c/users/6c23705d5c2e42de8dd0f0b5c5d1b10f/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:14.961877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8535d6d-8852-47f5-92ca-a5d040566c16 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:14.962127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8535d6d-8852-47f5-92ca-a5d040566c16 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:14.962399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8535d6d-8852-47f5-92ca-a5d040566c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:14.998621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-d8535d6d-8852-47f5-92ca-a5d040566c16 None None] MFA Rules not processed for user `6c23705d5c2e42de8dd0f0b5c5d1b10f`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:15.001567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d8535d6d-8852-47f5-92ca-a5d040566c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:15.095688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:15.108196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1021/2036] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:14 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:15.120503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:15.122433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:15.139176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:15.195209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53364984-0617-4ac6-a58b-889ccfafc4de admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:15.209731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5f2f4-23db-4fbc-8589-02be73acf5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:15.210757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f2f4-23db-4fbc-8589-02be73acf5eb service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:15.211202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f2f4-23db-4fbc-8589-02be73acf5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:15.211699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5f2f4-23db-4fbc-8589-02be73acf5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:15.224412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5f2f4-23db-4fbc-8589-02be73acf5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:15.226319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5f2f4-23db-4fbc-8589-02be73acf5eb service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:15.241234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1016/2037] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:15.302997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe02b-5635-47b1-8b06-50aa649f3dc5 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:15.305637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe02b-5635-47b1-8b06-50aa649f3dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:15.305954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe02b-5635-47b1-8b06-50aa649f3dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:15.395071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e8dbe02b-5635-47b1-8b06-50aa649f3dc5 None None] MFA Rules not processed for user `f7bfaa57173c4ef085e517805d8e5e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:15.397554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e8dbe02b-5635-47b1-8b06-50aa649f3dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:15.559315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5f2f4-23db-4fbc-8589-02be73acf5eb service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:15.569561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5f2f4-23db-4fbc-8589-02be73acf5eb service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:15.577059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0ecf8-a757-4d06-aada-7fefa4b35765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:15.577761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0ecf8-a757-4d06-aada-7fefa4b35765 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:15.578025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0ecf8-a757-4d06-aada-7fefa4b35765 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:15.578389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0ecf8-a757-4d06-aada-7fefa4b35765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:15.607769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1022/2038] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:15.638138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbe02b-5635-47b1-8b06-50aa649f3dc5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:15.657978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbe02b-5635-47b1-8b06-50aa649f3dc5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:15.674909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729a242-902d-4671-852c-e0724ee2e19f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:15.676016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a242-902d-4671-852c-e0724ee2e19f service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:15.676519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a242-902d-4671-852c-e0724ee2e19f service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:15.677005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a242-902d-4671-852c-e0724ee2e19f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:15.706408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729a242-902d-4671-852c-e0724ee2e19f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:15.707892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729a242-902d-4671-852c-e0724ee2e19f service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:15.732843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1023/2039] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:15.748188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0ecf8-a757-4d06-aada-7fefa4b35765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:15.751504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0ecf8-a757-4d06-aada-7fefa4b35765 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:15.772617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1017/2040] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:18.582412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979b299-a812-4454-9362-6229e5ec3a25 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:18.582962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979b299-a812-4454-9362-6229e5ec3a25 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:18.582962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979b299-a812-4454-9362-6229e5ec3a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:18.610823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-c979b299-a812-4454-9362-6229e5ec3a25 None None] MFA Rules not processed for user `f7bfaa57173c4ef085e517805d8e5e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:18.612077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c979b299-a812-4454-9362-6229e5ec3a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:18.627968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1024/2041] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:18.792142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0ecf8-a757-4d06-aada-7fefa4b35765 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:18.935970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0ecf8-a757-4d06-aada-7fefa4b35765 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:18.943928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:18.945473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:18.946100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:18.948205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] PATH_INFO: `/v3/users/4a9814d78dcc45fd8a9cf63cb0f54ea6` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:18.951254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9814d78dcc45fd8a9cf63cb0f54ea6)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:18.955893 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:19.188006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9814d78dcc45fd8a9cf63cb0f54ea6'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:19.188841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9814d78dcc45fd8a9cf63cb0f54ea6'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:19.219719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9814d78dcc45fd8a9cf63cb0f54ea6'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:19.220869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9814d78dcc45fd8a9cf63cb0f54ea6'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:19.223902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:19.240153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9814d78dcc45fd8a9cf63cb0f54ea6'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:19.326768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1018/2042] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:18 2022] DELETE /identity/v3/users/4a9814d78dcc45fd8a9cf63cb0f54ea6 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:19.332499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63899d2-a363-420e-adcf-00e03a5a39a1 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:19.333757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63899d2-a363-420e-adcf-00e03a5a39a1 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:19.334237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63899d2-a363-420e-adcf-00e03a5a39a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:19.375649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a63899d2-a363-420e-adcf-00e03a5a39a1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:19.376785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a63899d2-a363-420e-adcf-00e03a5a39a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:19.514396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1025/2043] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:19.526913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:19.529339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:19.664011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94efc-ae4b-435a-b8d0-1e770a053b3f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:19.669779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84f25-07ae-4689-8a10-0f36c5733664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:19.670916 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84f25-07ae-4689-8a10-0f36c5733664 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:19.671386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84f25-07ae-4689-8a10-0f36c5733664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:19.671998 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e84f25-07ae-4689-8a10-0f36c5733664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:19.709152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e84f25-07ae-4689-8a10-0f36c5733664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:19.712003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e84f25-07ae-4689-8a10-0f36c5733664 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:19.731410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1019/2044] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:20.386321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63899d2-a363-420e-adcf-00e03a5a39a1 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:20.388182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a63899d2-a363-420e-adcf-00e03a5a39a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:20.406741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63899d2-a363-420e-adcf-00e03a5a39a1 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:20.418396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:20.419364 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:20.420173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:20.421019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] PATH_INFO: `/v3/projects/265c2272fbd34c46993a9f4ec093e372` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:20.422997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] RBAC: Authorizing `identity:delete_project(project_id=265c2272fbd34c46993a9f4ec093e372)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:20.425026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:20.495921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265c2272fbd34c46993a9f4ec093e372', 'request_id': 'req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.509205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265c2272fbd34c46993a9f4ec093e372', 'request_id': 'req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.520473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265c2272fbd34c46993a9f4ec093e372', 'request_id': 'req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.522155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:20.542671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] The token cache is being invalidate because project 265c2272fbd34c46993a9f4ec093e372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:20.543374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.550105 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.552952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1026/2045] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:20 2022] DELETE /identity/v3/projects/265c2272fbd34c46993a9f4ec093e372 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:20.559871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84f25-07ae-4689-8a10-0f36c5733664 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:20.576139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e84f25-07ae-4689-8a10-0f36c5733664 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:20.681182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:20.684485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:20.684485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:20.684485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] PATH_INFO: `/v3/users/4bf69d2a66b943e893f7e07409728cf1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:20.685939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf69d2a66b943e893f7e07409728cf1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:20.692885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:20.781449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf69d2a66b943e893f7e07409728cf1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.782258 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf69d2a66b943e893f7e07409728cf1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.793977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf69d2a66b943e893f7e07409728cf1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.794877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf69d2a66b943e893f7e07409728cf1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.810990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-140c084d-bfd8-4bfb-9b21-40cc1c0e4cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf69d2a66b943e893f7e07409728cf1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:20.835454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:20.857667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1020/2046] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:20 2022] DELETE /identity/v3/users/4bf69d2a66b943e893f7e07409728cf1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:21.204956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:21.206565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:21.228146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff38a0-a0db-4e40-b3ca-c2db1a43823e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:21.325128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:21.326271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.326831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.327102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] PATH_INFO: `/v3/projects/c86bbfb51cd94a58b432184b7b4bf478` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:21.328458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86bbfb51cd94a58b432184b7b4bf478)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:21.332311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:21.409733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86bbfb51cd94a58b432184b7b4bf478', 'request_id': 'req-0eb4b3ff-4965-431f-8477-58cb91002d0b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:21.432485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86bbfb51cd94a58b432184b7b4bf478', 'request_id': 'req-0eb4b3ff-4965-431f-8477-58cb91002d0b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:21.450060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86bbfb51cd94a58b432184b7b4bf478', 'request_id': 'req-0eb4b3ff-4965-431f-8477-58cb91002d0b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:21.468847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] The token cache is being invalidate because project c86bbfb51cd94a58b432184b7b4bf478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:21.469204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:21.470004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0eb4b3ff-4965-431f-8477-58cb91002d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:21.472417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1027/2047] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:21 2022] DELETE /identity/v3/projects/c86bbfb51cd94a58b432184b7b4bf478 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:21.482880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74e64-48c4-4836-896b-dc90b5de782f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.483297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74e64-48c4-4836-896b-dc90b5de782f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.483765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e74e64-48c4-4836-896b-dc90b5de782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:21.513720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-75e74e64-48c4-4836-896b-dc90b5de782f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:21.516402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-75e74e64-48c4-4836-896b-dc90b5de782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:21.611766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1021/2048] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:21.622081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5713c-307c-4c72-8c75-827d1d5195cd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.622456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5713c-307c-4c72-8c75-827d1d5195cd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.622984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5713c-307c-4c72-8c75-827d1d5195cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:21.658145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-02a5713c-307c-4c72-8c75-827d1d5195cd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:21.660548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-02a5713c-307c-4c72-8c75-827d1d5195cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:21.669350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1028/2049] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:21.674076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74e64-48c4-4836-896b-dc90b5de782f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:21.687461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e74e64-48c4-4836-896b-dc90b5de782f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:21.697956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:21.698599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.698886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.699165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:21.699830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:21.700140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:21.701800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:21.715294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1022/2050] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:21.719944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5713c-307c-4c72-8c75-827d1d5195cd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:21.730012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5713c-307c-4c72-8c75-827d1d5195cd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:21.735032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0eb27-67ff-4c58-b508-15ac0c3c61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:21.735652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0eb27-67ff-4c58-b508-15ac0c3c61e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.735937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0eb27-67ff-4c58-b508-15ac0c3c61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.736218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0eb27-67ff-4c58-b508-15ac0c3c61e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:21.736897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0eb27-67ff-4c58-b508-15ac0c3c61e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:21.738869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0eb27-67ff-4c58-b508-15ac0c3c61e0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:21.774966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1029/2051] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:21 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:21.779363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:21.790267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9182fb2-b24c-4b97-8a3e-9bbc85ed5237 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:21.861152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cced-c357-4e57-99f2-15ffc4bebe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:21.861866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cced-c357-4e57-99f2-15ffc4bebe33 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.862193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cced-c357-4e57-99f2-15ffc4bebe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.862538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492cced-c357-4e57-99f2-15ffc4bebe33 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:21.863362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cced-c357-4e57-99f2-15ffc4bebe33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:21.867173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492cced-c357-4e57-99f2-15ffc4bebe33 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:21.893187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1023/2052] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:21 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:21.897611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0eb27-67ff-4c58-b508-15ac0c3c61e0 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:21.909450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0eb27-67ff-4c58-b508-15ac0c3c61e0 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:21.915439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1393-b3d9-4e98-a4e3-19010b416335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:21.915998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1393-b3d9-4e98-a4e3-19010b416335 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.916275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1393-b3d9-4e98-a4e3-19010b416335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.916638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1393-b3d9-4e98-a4e3-19010b416335 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:21.919050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e1393-b3d9-4e98-a4e3-19010b416335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:21.919605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e1393-b3d9-4e98-a4e3-19010b416335 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:21.935114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1030/2053] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:21.940767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cced-c357-4e57-99f2-15ffc4bebe33 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:21.954833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492cced-c357-4e57-99f2-15ffc4bebe33 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:21.961103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485e3a7-6f1b-416c-9937-aa1f0f8e983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:21.961677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e3a7-6f1b-416c-9937-aa1f0f8e983e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.961967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e3a7-6f1b-416c-9937-aa1f0f8e983e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.962429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e3a7-6f1b-416c-9937-aa1f0f8e983e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:21.963100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485e3a7-6f1b-416c-9937-aa1f0f8e983e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:21.964744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485e3a7-6f1b-416c-9937-aa1f0f8e983e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:21.976891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1024/2054] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:21.981661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1393-b3d9-4e98-a4e3-19010b416335 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:21.992951 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1393-b3d9-4e98-a4e3-19010b416335 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:21.998405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93c1b-2f21-40d4-aa06-e4b27df02d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:21.999121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93c1b-2f21-40d4-aa06-e4b27df02d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:21.999362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93c1b-2f21-40d4-aa06-e4b27df02d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:21.999642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b93c1b-2f21-40d4-aa06-e4b27df02d0c admin admin] PATH_INFO: `/v3/projects/1c38667448ee4d9aa8dc724d642a9459/users/9236b63aad114031a11b37395934cf25/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.018622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93c1b-2f21-40d4-aa06-e4b27df02d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c38667448ee4d9aa8dc724d642a9459, user_id=9236b63aad114031a11b37395934cf25, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:22.021794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b93c1b-2f21-40d4-aa06-e4b27df02d0c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:22.048841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1031/2055] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:21 2022] PUT /identity/v3/projects/1c38667448ee4d9aa8dc724d642a9459/users/9236b63aad114031a11b37395934cf25/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:22.073798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840e77-440a-4072-89cd-734d08f10814 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:22.074555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840e77-440a-4072-89cd-734d08f10814 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:22.075030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16840e77-440a-4072-89cd-734d08f10814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.142089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-16840e77-440a-4072-89cd-734d08f10814 None None] MFA Rules not processed for user `9236b63aad114031a11b37395934cf25`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:22.143310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-16840e77-440a-4072-89cd-734d08f10814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:22.205317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:22.229366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1025/2056] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:22.234585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93c1b-2f21-40d4-aa06-e4b27df02d0c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:22.264960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:22.363046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b93c1b-2f21-40d4-aa06-e4b27df02d0c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:22.369218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f4f6-d3a2-4a1a-a59e-7c5ed9fa7a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:22.369875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f4f6-d3a2-4a1a-a59e-7c5ed9fa7a29 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:22.370155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f4f6-d3a2-4a1a-a59e-7c5ed9fa7a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:22.370431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f4f6-d3a2-4a1a-a59e-7c5ed9fa7a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.371411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11f4f6-d3a2-4a1a-a59e-7c5ed9fa7a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:22.373339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11f4f6-d3a2-4a1a-a59e-7c5ed9fa7a29 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:22.448317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1032/2057] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:22 2022] POST /identity/v3/projects => generated 389 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:22.450494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840e77-440a-4072-89cd-734d08f10814 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:22.467122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16840e77-440a-4072-89cd-734d08f10814 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:22.552183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914a470-0413-412a-9db2-ab9452ff92dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:22.553172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a470-0413-412a-9db2-ab9452ff92dd admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:22.553500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a470-0413-412a-9db2-ab9452ff92dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:22.553895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914a470-0413-412a-9db2-ab9452ff92dd admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.554705 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914a470-0413-412a-9db2-ab9452ff92dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:22.557472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914a470-0413-412a-9db2-ab9452ff92dd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:22.598242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1026/2058] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:22 2022] POST /identity/v3/users => generated 301 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:22.602662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f4f6-d3a2-4a1a-a59e-7c5ed9fa7a29 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:22.619545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f4f6-d3a2-4a1a-a59e-7c5ed9fa7a29 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:22.627131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb005c8-262b-450c-bb10-dfb0e4a22308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:22.628143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb005c8-262b-450c-bb10-dfb0e4a22308 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:22.628590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb005c8-262b-450c-bb10-dfb0e4a22308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:22.629314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb005c8-262b-450c-bb10-dfb0e4a22308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.630254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb005c8-262b-450c-bb10-dfb0e4a22308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:22.632338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb005c8-262b-450c-bb10-dfb0e4a22308 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:22.672941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1033/2059] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:22.677168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914a470-0413-412a-9db2-ab9452ff92dd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:22.690318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914a470-0413-412a-9db2-ab9452ff92dd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:22.706890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18cb1-eea9-4e11-b79a-640fbdd5ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:22.708688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18cb1-eea9-4e11-b79a-640fbdd5ded8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:22.709187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18cb1-eea9-4e11-b79a-640fbdd5ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:22.709827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18cb1-eea9-4e11-b79a-640fbdd5ded8 admin admin] PATH_INFO: `/v3/projects/c6abc1b916ce458dbd35b55f40839509/users/b562913678f14f26b9dd1db4b52ddcd1/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.733264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb18cb1-eea9-4e11-b79a-640fbdd5ded8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6abc1b916ce458dbd35b55f40839509, user_id=b562913678f14f26b9dd1db4b52ddcd1, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:22.736704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb18cb1-eea9-4e11-b79a-640fbdd5ded8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:22.765945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1027/2060] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:22 2022] PUT /identity/v3/projects/c6abc1b916ce458dbd35b55f40839509/users/b562913678f14f26b9dd1db4b52ddcd1/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:22.770686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb005c8-262b-450c-bb10-dfb0e4a22308 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:22.785317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb005c8-262b-450c-bb10-dfb0e4a22308 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:22.862548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce8bdf-eb95-43cb-bba9-e2f2d3a00f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:22.863178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce8bdf-eb95-43cb-bba9-e2f2d3a00f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:22.863456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce8bdf-eb95-43cb-bba9-e2f2d3a00f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:22.863727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce8bdf-eb95-43cb-bba9-e2f2d3a00f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.864379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce8bdf-eb95-43cb-bba9-e2f2d3a00f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:22.866235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce8bdf-eb95-43cb-bba9-e2f2d3a00f3b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:22.878673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1034/2061] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:22.883052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18cb1-eea9-4e11-b79a-640fbdd5ded8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:22.896386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18cb1-eea9-4e11-b79a-640fbdd5ded8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:22.901508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:22.902248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:22.902703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:22.903113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] PATH_INFO: `/v3/projects/c6abc1b916ce458dbd35b55f40839509/users/b562913678f14f26b9dd1db4b52ddcd1/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.905619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6abc1b916ce458dbd35b55f40839509, user_id=b562913678f14f26b9dd1db4b52ddcd1, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:22.908461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:22.921509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1028/2062] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:22 2022] PUT /identity/v3/projects/c6abc1b916ce458dbd35b55f40839509/users/b562913678f14f26b9dd1db4b52ddcd1/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:22.933409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696018c-f205-4b75-ba06-2fefc6365035 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:22.933822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696018c-f205-4b75-ba06-2fefc6365035 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:22.933922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696018c-f205-4b75-ba06-2fefc6365035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:22.969600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e696018c-f205-4b75-ba06-2fefc6365035 None None] MFA Rules not processed for user `b562913678f14f26b9dd1db4b52ddcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:22.971058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e696018c-f205-4b75-ba06-2fefc6365035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:23.081878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1035/2063] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:23.094549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:23.099168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:23.180841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762f447-ef42-457f-bc34-6768348a35d9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:23.185501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e7553-d555-4bbe-9b2f-6495d9d7c536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:23.186083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e7553-d555-4bbe-9b2f-6495d9d7c536 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:23.186454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e7553-d555-4bbe-9b2f-6495d9d7c536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:23.186738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e7553-d555-4bbe-9b2f-6495d9d7c536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:23.197564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e7553-d555-4bbe-9b2f-6495d9d7c536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:23.200017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e7553-d555-4bbe-9b2f-6495d9d7c536 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:23.212117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1029/2064] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:23 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:23.259228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696018c-f205-4b75-ba06-2fefc6365035 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:23.261092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e696018c-f205-4b75-ba06-2fefc6365035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:23.280575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:23.377485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e696018c-f205-4b75-ba06-2fefc6365035 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:23.383646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:23.384729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:23.385121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:23.385587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] PATH_INFO: `/v3/users/a9d4ec1e69324fc09962b53fb1a5806e` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:23.387284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d4ec1e69324fc09962b53fb1a5806e)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:23.391803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:23.393711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e7553-d555-4bbe-9b2f-6495d9d7c536 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:23.413211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e7553-d555-4bbe-9b2f-6495d9d7c536 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:23.421640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:23.422541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:23.423180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:23.423697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] PATH_INFO: `/v3/users/9236b63aad114031a11b37395934cf25` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:23.426075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9236b63aad114031a11b37395934cf25)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:23.430151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:23.448645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d4ec1e69324fc09962b53fb1a5806e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.456569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d4ec1e69324fc09962b53fb1a5806e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.457599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d4ec1e69324fc09962b53fb1a5806e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.458228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d4ec1e69324fc09962b53fb1a5806e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.467361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3ea6f77c-b0bb-41c7-8a3e-75bf030e4e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d4ec1e69324fc09962b53fb1a5806e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.480917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:23.487667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1036/2065] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:23 2022] DELETE /identity/v3/users/a9d4ec1e69324fc09962b53fb1a5806e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:23.488202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9236b63aad114031a11b37395934cf25'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.490917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9236b63aad114031a11b37395934cf25'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.493026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072923-2504-4606-8f10-3d5c6c00223f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:23.493549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072923-2504-4606-8f10-3d5c6c00223f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:23.493895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072923-2504-4606-8f10-3d5c6c00223f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:23.501680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9236b63aad114031a11b37395934cf25'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.502398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9236b63aad114031a11b37395934cf25'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.511089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8e5e8bcf-bcd5-4eff-af00-fe6a05c95c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9236b63aad114031a11b37395934cf25'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:23.518196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-27072923-2504-4606-8f10-3d5c6c00223f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:23.519322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-27072923-2504-4606-8f10-3d5c6c00223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:23.534272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1030/2066] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:23 2022] DELETE /identity/v3/users/9236b63aad114031a11b37395934cf25 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:23.539088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dd496-ffde-420a-9958-f46958ed696d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:23.539911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dd496-ffde-420a-9958-f46958ed696d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:23.540189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dd496-ffde-420a-9958-f46958ed696d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:23.560144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c27dd496-ffde-420a-9958-f46958ed696d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:23.562206 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c27dd496-ffde-420a-9958-f46958ed696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:23.600165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1037/2067] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:23.607358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072923-2504-4606-8f10-3d5c6c00223f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:23.609213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-27072923-2504-4606-8f10-3d5c6c00223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:23.659711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1031/2068] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:23.661483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:23.670971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dd496-ffde-420a-9958-f46958ed696d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:23.673034 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c27dd496-ffde-420a-9958-f46958ed696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:23.710438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072923-2504-4606-8f10-3d5c6c00223f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:23.790232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dd496-ffde-420a-9958-f46958ed696d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:23.793807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:23.794747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:23.795138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:23.795511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:23.795885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:23.796822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:23.797300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:23.797625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:23.809429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:23.814181 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:23.830365 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:23.831994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:23.837316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1038/2069] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:23.854514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1032/2070] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:24.577324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:24.579827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:24.586317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:24.588099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:24.595643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9cc6-ca95-4636-93ac-b90b25bcee04 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:24.601317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:24.602661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:24.603014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:24.603358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] PATH_INFO: `/v3/projects/faabfa4b36d44834a1e5483b61c6165f` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:24.604996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faabfa4b36d44834a1e5483b61c6165f)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:24.607765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:24.616653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bd26e-d63c-4dab-ab65-a4e0d19f939b service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:24.628652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:24.629892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:24.630387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:24.630866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] PATH_INFO: `/v3/projects/1c38667448ee4d9aa8dc724d642a9459` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:24.632779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c38667448ee4d9aa8dc724d642a9459)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:24.635560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:24.677793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faabfa4b36d44834a1e5483b61c6165f', 'request_id': 'req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.690004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faabfa4b36d44834a1e5483b61c6165f', 'request_id': 'req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.699608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faabfa4b36d44834a1e5483b61c6165f', 'request_id': 'req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.700312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c38667448ee4d9aa8dc724d642a9459', 'request_id': 'req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.713247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c38667448ee4d9aa8dc724d642a9459', 'request_id': 'req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.715060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:24.715224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] The token cache is being invalidate because project faabfa4b36d44834a1e5483b61c6165f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:24.715459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.716259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.717778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1039/2071] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:24 2022] DELETE /identity/v3/projects/faabfa4b36d44834a1e5483b61c6165f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:24.722318 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:24.722572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c38667448ee4d9aa8dc724d642a9459', 'request_id': 'req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.724716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:24.738824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] The token cache is being invalidate because project 1c38667448ee4d9aa8dc724d642a9459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:24.739309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.740049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.742649 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1033/2072] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:24 2022] DELETE /identity/v3/projects/1c38667448ee4d9aa8dc724d642a9459 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:24.748247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:24.750588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:24.808154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29204ff9-5654-4cc7-bfdb-98ef418fc2e5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:24.827469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76b1e6-fc79-4da5-ba9e-cc0b4bde5562 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:24.828037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:24.840678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:24.841415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:24.842118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:24.842364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] PATH_INFO: `/v3/users/b562913678f14f26b9dd1db4b52ddcd1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:24.844314 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b562913678f14f26b9dd1db4b52ddcd1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:24.846713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:24.876470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:24.877102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:24.877429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:24.877774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] PATH_INFO: `/v3/users/6c23705d5c2e42de8dd0f0b5c5d1b10f` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:24.879277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c23705d5c2e42de8dd0f0b5c5d1b10f)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:24.882263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:24.911648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b562913678f14f26b9dd1db4b52ddcd1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.912491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b562913678f14f26b9dd1db4b52ddcd1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.923626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b562913678f14f26b9dd1db4b52ddcd1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.924404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b562913678f14f26b9dd1db4b52ddcd1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.939559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b562913678f14f26b9dd1db4b52ddcd1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.958049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c23705d5c2e42de8dd0f0b5c5d1b10f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.967684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c23705d5c2e42de8dd0f0b5c5d1b10f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.968474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c23705d5c2e42de8dd0f0b5c5d1b10f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.969628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1034/2073] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:24 2022] DELETE /identity/v3/users/b562913678f14f26b9dd1db4b52ddcd1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:24.969741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c23705d5c2e42de8dd0f0b5c5d1b10f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:24.979554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c23705d5c2e42de8dd0f0b5c5d1b10f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.029975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1040/2074] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:24 2022] DELETE /identity/v3/users/6c23705d5c2e42de8dd0f0b5c5d1b10f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:25.506244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:25.508451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:25.630405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb45bc4-66c3-4c54-aeba-5731ca0cb4d7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:25.646968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:25.672837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:25.675126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:25.735124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:25.735776 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:25.736087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:25.736360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] PATH_INFO: `/v3/projects/c6abc1b916ce458dbd35b55f40839509` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:25.737546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6abc1b916ce458dbd35b55f40839509)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:25.739698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:25.790659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6abc1b916ce458dbd35b55f40839509', 'request_id': 'req-311da794-7628-4c53-9c9a-f9a3eb7fa24f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.791974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08195f1e-0319-4505-9372-34030027bf6b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:25.798879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6abc1b916ce458dbd35b55f40839509', 'request_id': 'req-311da794-7628-4c53-9c9a-f9a3eb7fa24f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.806653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6abc1b916ce458dbd35b55f40839509', 'request_id': 'req-311da794-7628-4c53-9c9a-f9a3eb7fa24f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.818972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] The token cache is being invalidate because project c6abc1b916ce458dbd35b55f40839509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:25.819390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.820192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-311da794-7628-4c53-9c9a-f9a3eb7fa24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.822220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1035/2075] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:25 2022] DELETE /identity/v3/projects/c6abc1b916ce458dbd35b55f40839509 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:25.827239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354636fd-ccd4-4bdd-8c9b-0fd4c9e36cdd None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:25.827550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354636fd-ccd4-4bdd-8c9b-0fd4c9e36cdd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:25.828212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354636fd-ccd4-4bdd-8c9b-0fd4c9e36cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:25.844455 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:25.851627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-354636fd-ccd4-4bdd-8c9b-0fd4c9e36cdd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:25.853278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-354636fd-ccd4-4bdd-8c9b-0fd4c9e36cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:25.860568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:25.861244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:25.861543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:25.861822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] PATH_INFO: `/v3/projects/b834a40902754a31a7bc60c0e192001c` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:25.862964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b834a40902754a31a7bc60c0e192001c)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:25.864900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:25.916928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b834a40902754a31a7bc60c0e192001c', 'request_id': 'req-72706969-4b32-482b-b17f-7410d7b5dc3a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.928614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1036/2076] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:25.928847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b834a40902754a31a7bc60c0e192001c', 'request_id': 'req-72706969-4b32-482b-b17f-7410d7b5dc3a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.930925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d96be-54ce-4ecc-b76b-8292f2735b4c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:25.931214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d96be-54ce-4ecc-b76b-8292f2735b4c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:25.931490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d96be-54ce-4ecc-b76b-8292f2735b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:25.933804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b834a40902754a31a7bc60c0e192001c', 'request_id': 'req-72706969-4b32-482b-b17f-7410d7b5dc3a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.946639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] The token cache is being invalidate because project b834a40902754a31a7bc60c0e192001c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:25.946931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.947606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-72706969-4b32-482b-b17f-7410d7b5dc3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:25.949213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1041/2077] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:25 2022] DELETE /identity/v3/projects/b834a40902754a31a7bc60c0e192001c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:25.954317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6c3d96be-54ce-4ecc-b76b-8292f2735b4c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:25.954809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae0b1-b194-41ce-88aa-4040488352a4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:25.956060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6c3d96be-54ce-4ecc-b76b-8292f2735b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:25.956215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae0b1-b194-41ce-88aa-4040488352a4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:25.956417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ae0b1-b194-41ce-88aa-4040488352a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:25.976150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1c3ae0b1-b194-41ce-88aa-4040488352a4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:25.977420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1c3ae0b1-b194-41ce-88aa-4040488352a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:26.003419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:26.031767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1037/2078] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:26.036210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d96be-54ce-4ecc-b76b-8292f2735b4c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.047471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1042/2079] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:26.050252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d96be-54ce-4ecc-b76b-8292f2735b4c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.055877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229fb93-4e5a-428d-944b-e306d3f356fb None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.056167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229fb93-4e5a-428d-944b-e306d3f356fb None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.056315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.056438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229fb93-4e5a-428d-944b-e306d3f356fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.056933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.057209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.057533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.058163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:26.058462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.060709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.073917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1038/2080] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:40:26.078317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5229fb93-4e5a-428d-944b-e306d3f356fb None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:26.078468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.079546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5229fb93-4e5a-428d-944b-e306d3f356fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:26.087794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1043/2081] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:26.088697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be8ed1-130a-4f6f-944a-e039eaab3ab7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.092013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229fb93-4e5a-428d-944b-e306d3f356fb None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.093555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b4237-d92d-493f-971e-4acab48c7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.094161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b4237-d92d-493f-971e-4acab48c7a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.094441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b4237-d92d-493f-971e-4acab48c7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.094712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b4237-d92d-493f-971e-4acab48c7a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.095367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b4237-d92d-493f-971e-4acab48c7a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.097375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b4237-d92d-493f-971e-4acab48c7a7b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.102294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229fb93-4e5a-428d-944b-e306d3f356fb None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.107187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.107804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.108127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.108407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.109087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:26.109399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.111149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.127504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1044/2082] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:40:26.133906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1039/2083] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:26.134107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.135537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b4237-d92d-493f-971e-4acab48c7a7b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.159128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83069f-c2bb-4751-b385-b7ab71f431c8 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.202770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b4237-d92d-493f-971e-4acab48c7a7b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.207692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf31023-f351-4515-adef-2bd04a5018b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.208533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31023-f351-4515-adef-2bd04a5018b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.208816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31023-f351-4515-adef-2bd04a5018b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.209089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf31023-f351-4515-adef-2bd04a5018b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.210074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf31023-f351-4515-adef-2bd04a5018b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.212409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf31023-f351-4515-adef-2bd04a5018b9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.214347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:26.222310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7281ab-a628-4146-9c8a-3e9422155f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.223509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7281ab-a628-4146-9c8a-3e9422155f0b admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.223989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7281ab-a628-4146-9c8a-3e9422155f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.224261 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7281ab-a628-4146-9c8a-3e9422155f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.224961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7281ab-a628-4146-9c8a-3e9422155f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.227632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7281ab-a628-4146-9c8a-3e9422155f0b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.238822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1040/2084] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:26.244550 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf31023-f351-4515-adef-2bd04a5018b9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.255327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf31023-f351-4515-adef-2bd04a5018b9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.260558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979e598-a3fb-4ff3-ac69-f2c4618cee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.260718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1045/2085] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:26.261128 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979e598-a3fb-4ff3-ac69-f2c4618cee72 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.261421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979e598-a3fb-4ff3-ac69-f2c4618cee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.261752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979e598-a3fb-4ff3-ac69-f2c4618cee72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.262405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979e598-a3fb-4ff3-ac69-f2c4618cee72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.264285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979e598-a3fb-4ff3-ac69-f2c4618cee72 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.264886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7281ab-a628-4146-9c8a-3e9422155f0b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.275321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1041/2086] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:26.279447 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979e598-a3fb-4ff3-ac69-f2c4618cee72 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.290008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979e598-a3fb-4ff3-ac69-f2c4618cee72 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.356289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7281ab-a628-4146-9c8a-3e9422155f0b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.362043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de09916-b711-4ba5-9da3-384647d2ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.362915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de09916-b711-4ba5-9da3-384647d2ffa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.363212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de09916-b711-4ba5-9da3-384647d2ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.363461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52749377-302a-47d0-9e17-4311831cb0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.363588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de09916-b711-4ba5-9da3-384647d2ffa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.364121 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de09916-b711-4ba5-9da3-384647d2ffa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.364633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52749377-302a-47d0-9e17-4311831cb0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.365070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52749377-302a-47d0-9e17-4311831cb0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.365564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52749377-302a-47d0-9e17-4311831cb0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.366106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de09916-b711-4ba5-9da3-384647d2ffa6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.366546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52749377-302a-47d0-9e17-4311831cb0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.369058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52749377-302a-47d0-9e17-4311831cb0b1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.393646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1042/2087] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:26.395329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52749377-302a-47d0-9e17-4311831cb0b1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.402811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1046/2088] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:26.407274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de09916-b711-4ba5-9da3-384647d2ffa6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.420223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52749377-302a-47d0-9e17-4311831cb0b1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.424150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de09916-b711-4ba5-9da3-384647d2ffa6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.429986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18b23-27e1-423c-b22d-ba960784fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.431019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18b23-27e1-423c-b22d-ba960784fde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.431436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18b23-27e1-423c-b22d-ba960784fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.432569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18b23-27e1-423c-b22d-ba960784fde8 admin admin] PATH_INFO: `/v3/projects/01ad107a181b4e46a63d93a8fa89889a/users/766200ec3bbb40a8967e5182eb9b864f/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.446246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481392f4-ed43-4424-ba19-11392381eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.447638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481392f4-ed43-4424-ba19-11392381eebd admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.448013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481392f4-ed43-4424-ba19-11392381eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.448384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481392f4-ed43-4424-ba19-11392381eebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.449621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481392f4-ed43-4424-ba19-11392381eebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.451356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d18b23-27e1-423c-b22d-ba960784fde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ad107a181b4e46a63d93a8fa89889a, user_id=766200ec3bbb40a8967e5182eb9b864f, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.451710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481392f4-ed43-4424-ba19-11392381eebd admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.456028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d18b23-27e1-423c-b22d-ba960784fde8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.467148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:26.473323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1047/2089] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:26.474972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481392f4-ed43-4424-ba19-11392381eebd admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.477596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1043/2090] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:26 2022] PUT /identity/v3/projects/01ad107a181b4e46a63d93a8fa89889a/users/766200ec3bbb40a8967e5182eb9b864f/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:26.489555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df789491-7d68-4ea0-a495-3caf0a777df6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.490105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df789491-7d68-4ea0-a495-3caf0a777df6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.490580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df789491-7d68-4ea0-a495-3caf0a777df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.493806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481392f4-ed43-4424-ba19-11392381eebd admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.547930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-df789491-7d68-4ea0-a495-3caf0a777df6 None None] MFA Rules not processed for user `766200ec3bbb40a8967e5182eb9b864f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:26.549222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-df789491-7d68-4ea0-a495-3caf0a777df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:26.573227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44afc7-856e-4eb0-a83c-14db71b93f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.574473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44afc7-856e-4eb0-a83c-14db71b93f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.574833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44afc7-856e-4eb0-a83c-14db71b93f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.575222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44afc7-856e-4eb0-a83c-14db71b93f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.576276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44afc7-856e-4eb0-a83c-14db71b93f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.578605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44afc7-856e-4eb0-a83c-14db71b93f13 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.598387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1048/2091] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:26.603812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44afc7-856e-4eb0-a83c-14db71b93f13 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.616430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44afc7-856e-4eb0-a83c-14db71b93f13 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.621742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b2525-f463-4f59-a229-b5f204d645e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.622476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2525-f463-4f59-a229-b5f204d645e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.622785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2525-f463-4f59-a229-b5f204d645e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.623206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2525-f463-4f59-a229-b5f204d645e6 admin admin] PATH_INFO: `/v3/projects/5245835207cc4f1080896bdba410bffe/users/3077314a17a84a6196e054d2dcd59fd2/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.641444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1044/2092] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:26.642407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df789491-7d68-4ea0-a495-3caf0a777df6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.643096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b2525-f463-4f59-a229-b5f204d645e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5245835207cc4f1080896bdba410bffe, user_id=3077314a17a84a6196e054d2dcd59fd2, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.645882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b2525-f463-4f59-a229-b5f204d645e6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.657106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df789491-7d68-4ea0-a495-3caf0a777df6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.670062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1049/2093] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:26 2022] PUT /identity/v3/projects/5245835207cc4f1080896bdba410bffe/users/3077314a17a84a6196e054d2dcd59fd2/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:26.680537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a0d40-84ae-4058-91b2-37e55f8a551d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.681268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a0d40-84ae-4058-91b2-37e55f8a551d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.681268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a0d40-84ae-4058-91b2-37e55f8a551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.740598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-776a0d40-84ae-4058-91b2-37e55f8a551d None None] MFA Rules not processed for user `3077314a17a84a6196e054d2dcd59fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:26.742344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-776a0d40-84ae-4058-91b2-37e55f8a551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:26.751105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b2a81-4f79-41b4-a5a7-b1ebb034a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.751735 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2a81-4f79-41b4-a5a7-b1ebb034a277 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.752019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2a81-4f79-41b4-a5a7-b1ebb034a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.752302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b2a81-4f79-41b4-a5a7-b1ebb034a277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.752933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b2a81-4f79-41b4-a5a7-b1ebb034a277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.754916 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b2a81-4f79-41b4-a5a7-b1ebb034a277 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.766150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:26.791074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1045/2094] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:26.795146 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b2a81-4f79-41b4-a5a7-b1ebb034a277 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.836008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1050/2095] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:26.842589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a0d40-84ae-4058-91b2-37e55f8a551d None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.854375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a0d40-84ae-4058-91b2-37e55f8a551d None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.867210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b2a81-4f79-41b4-a5a7-b1ebb034a277 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.872595 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9483a-888b-49d2-83aa-58136598c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.873325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9483a-888b-49d2-83aa-58136598c5bf admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.873647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9483a-888b-49d2-83aa-58136598c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.873920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9483a-888b-49d2-83aa-58136598c5bf admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.874573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9483a-888b-49d2-83aa-58136598c5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.877217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9483a-888b-49d2-83aa-58136598c5bf admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.923515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1046/2096] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:26.927835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9483a-888b-49d2-83aa-58136598c5bf admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.933134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:26.943932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9483a-888b-49d2-83aa-58136598c5bf admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:26.952459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c8342-c3fd-4d23-bd88-4801cc444794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.953287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c8342-c3fd-4d23-bd88-4801cc444794 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.954293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c8342-c3fd-4d23-bd88-4801cc444794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.954425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c8342-c3fd-4d23-bd88-4801cc444794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.955329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c8342-c3fd-4d23-bd88-4801cc444794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.956514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18f131-4529-48f8-a56f-745b3944cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:26.958027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c8342-c3fd-4d23-bd88-4801cc444794 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.961863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18f131-4529-48f8-a56f-745b3944cb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:26.962203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18f131-4529-48f8-a56f-745b3944cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:26.962488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18f131-4529-48f8-a56f-745b3944cb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:26.963163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18f131-4529-48f8-a56f-745b3944cb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:26.964973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18f131-4529-48f8-a56f-745b3944cb9f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:26.979979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1047/2097] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:26.983964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18f131-4529-48f8-a56f-745b3944cb9f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:26.999123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18f131-4529-48f8-a56f-745b3944cb9f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.007374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26653580-c97e-4099-92a7-eb4cf5306e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.008532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26653580-c97e-4099-92a7-eb4cf5306e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.009135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26653580-c97e-4099-92a7-eb4cf5306e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.009699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26653580-c97e-4099-92a7-eb4cf5306e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.010364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26653580-c97e-4099-92a7-eb4cf5306e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.010853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1051/2098] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:26 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:27.012126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26653580-c97e-4099-92a7-eb4cf5306e65 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.014766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c8342-c3fd-4d23-bd88-4801cc444794 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.025138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1048/2099] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:27.029620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26653580-c97e-4099-92a7-eb4cf5306e65 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.041101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26653580-c97e-4099-92a7-eb4cf5306e65 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.080253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c8342-c3fd-4d23-bd88-4801cc444794 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.084885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170335a-8efc-4798-aa3a-7bc0dd01ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.085498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170335a-8efc-4798-aa3a-7bc0dd01ad1b admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.085814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170335a-8efc-4798-aa3a-7bc0dd01ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.086657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170335a-8efc-4798-aa3a-7bc0dd01ad1b admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.087305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170335a-8efc-4798-aa3a-7bc0dd01ad1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.089231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170335a-8efc-4798-aa3a-7bc0dd01ad1b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.099409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3146188-aa11-4c96-a336-c18e71b1e181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.100188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146188-aa11-4c96-a336-c18e71b1e181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.100533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146188-aa11-4c96-a336-c18e71b1e181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.100814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3146188-aa11-4c96-a336-c18e71b1e181 admin admin] PATH_INFO: `/v3/projects/076182300d334be7b50b66b306af161a/users/9d0bbe091f1f48a1bfcf3bafa6408448/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.110874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1052/2100] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:27 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:27.115142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170335a-8efc-4798-aa3a-7bc0dd01ad1b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.120193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3146188-aa11-4c96-a336-c18e71b1e181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076182300d334be7b50b66b306af161a, user_id=9d0bbe091f1f48a1bfcf3bafa6408448, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.123513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3146188-aa11-4c96-a336-c18e71b1e181 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.125072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170335a-8efc-4798-aa3a-7bc0dd01ad1b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.130357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f4a6c-38cc-43cc-99fc-2abf58983b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.131034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4a6c-38cc-43cc-99fc-2abf58983b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.131343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4a6c-38cc-43cc-99fc-2abf58983b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.131648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4a6c-38cc-43cc-99fc-2abf58983b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.132371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f4a6c-38cc-43cc-99fc-2abf58983b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.134785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f4a6c-38cc-43cc-99fc-2abf58983b2c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.138551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1049/2101] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:27 2022] PUT /identity/v3/projects/076182300d334be7b50b66b306af161a/users/9d0bbe091f1f48a1bfcf3bafa6408448/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:27.149464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48bc45-cfed-4daa-b8c0-83fb7f2549d4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.149780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48bc45-cfed-4daa-b8c0-83fb7f2549d4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.150055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48bc45-cfed-4daa-b8c0-83fb7f2549d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.152294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1053/2102] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:27.156283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f4a6c-38cc-43cc-99fc-2abf58983b2c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.166868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f4a6c-38cc-43cc-99fc-2abf58983b2c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.178376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ca48bc45-cfed-4daa-b8c0-83fb7f2549d4 None None] MFA Rules not processed for user `9d0bbe091f1f48a1bfcf3bafa6408448`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:27.179554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ca48bc45-cfed-4daa-b8c0-83fb7f2549d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:27.193057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:27.229658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8966e1b-649a-4223-9bb5-9dd635d0a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.230443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966e1b-649a-4223-9bb5-9dd635d0a77e admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.230732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966e1b-649a-4223-9bb5-9dd635d0a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.231011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8966e1b-649a-4223-9bb5-9dd635d0a77e admin admin] PATH_INFO: `/v3/projects/10a3ca9ce1ba48298b82abd20dbda904/users/65de74f1c2344742a67e00df1cb05323/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.248882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8966e1b-649a-4223-9bb5-9dd635d0a77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a3ca9ce1ba48298b82abd20dbda904, user_id=65de74f1c2344742a67e00df1cb05323, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.249071 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1050/2103] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:27.251482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8966e1b-649a-4223-9bb5-9dd635d0a77e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.253150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48bc45-cfed-4daa-b8c0-83fb7f2549d4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.265982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48bc45-cfed-4daa-b8c0-83fb7f2549d4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.266503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1054/2104] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:27 2022] PUT /identity/v3/projects/10a3ca9ce1ba48298b82abd20dbda904/users/65de74f1c2344742a67e00df1cb05323/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:27.270419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8966e1b-649a-4223-9bb5-9dd635d0a77e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.319421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:27.333376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98d57d-eec4-4765-8432-8dc89a9d91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.334047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d57d-eec4-4765-8432-8dc89a9d91c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.334335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d57d-eec4-4765-8432-8dc89a9d91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.334612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d57d-eec4-4765-8432-8dc89a9d91c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.335293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98d57d-eec4-4765-8432-8dc89a9d91c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.337326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98d57d-eec4-4765-8432-8dc89a9d91c3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.342156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8966e1b-649a-4223-9bb5-9dd635d0a77e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.346899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a55fa-ddbd-4fe8-a81c-3267d2b3eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.347504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a55fa-ddbd-4fe8-a81c-3267d2b3eba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.347787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a55fa-ddbd-4fe8-a81c-3267d2b3eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.348062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a55fa-ddbd-4fe8-a81c-3267d2b3eba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.348703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a55fa-ddbd-4fe8-a81c-3267d2b3eba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.350341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a55fa-ddbd-4fe8-a81c-3267d2b3eba6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.361657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1055/2105] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:27.365757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a55fa-ddbd-4fe8-a81c-3267d2b3eba6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.367036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1051/2106] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:27 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:27.371404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98d57d-eec4-4765-8432-8dc89a9d91c3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.376272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a55fa-ddbd-4fe8-a81c-3267d2b3eba6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.434939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510f63c-57a5-4c51-8863-8d557020008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.435622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510f63c-57a5-4c51-8863-8d557020008d admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.435896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510f63c-57a5-4c51-8863-8d557020008d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.436176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510f63c-57a5-4c51-8863-8d557020008d admin admin] PATH_INFO: `/v3/projects/10a3ca9ce1ba48298b82abd20dbda904/users/65de74f1c2344742a67e00df1cb05323/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.436938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98d57d-eec4-4765-8432-8dc89a9d91c3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.438293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510f63c-57a5-4c51-8863-8d557020008d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a3ca9ce1ba48298b82abd20dbda904, user_id=65de74f1c2344742a67e00df1cb05323, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.441115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510f63c-57a5-4c51-8863-8d557020008d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.442788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dce35-23f7-47ac-8752-98c351560256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.443423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dce35-23f7-47ac-8752-98c351560256 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.443645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dce35-23f7-47ac-8752-98c351560256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.443921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dce35-23f7-47ac-8752-98c351560256 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.444603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dce35-23f7-47ac-8752-98c351560256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.447189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dce35-23f7-47ac-8752-98c351560256 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.453248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1056/2107] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:27 2022] PUT /identity/v3/projects/10a3ca9ce1ba48298b82abd20dbda904/users/65de74f1c2344742a67e00df1cb05323/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:27.465415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708c7a-9c71-43a5-b895-a967d36cdc96 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.465746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708c7a-9c71-43a5-b895-a967d36cdc96 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.466344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708c7a-9c71-43a5-b895-a967d36cdc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.478980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1052/2108] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:27 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:27.482656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dce35-23f7-47ac-8752-98c351560256 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.493399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dce35-23f7-47ac-8752-98c351560256 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.500606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ed708c7a-9c71-43a5-b895-a967d36cdc96 None None] MFA Rules not processed for user `65de74f1c2344742a67e00df1cb05323`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:27.502004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ed708c7a-9c71-43a5-b895-a967d36cdc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:27.544364 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:27.576621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4c4e4-6df9-4562-975c-f8025f3d9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.577251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c4e4-6df9-4562-975c-f8025f3d9976 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.577571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c4e4-6df9-4562-975c-f8025f3d9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.577907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c4e4-6df9-4562-975c-f8025f3d9976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.578564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4c4e4-6df9-4562-975c-f8025f3d9976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.580993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4c4e4-6df9-4562-975c-f8025f3d9976 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.593307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1053/2109] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:27.598379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4c4e4-6df9-4562-975c-f8025f3d9976 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.606511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1057/2110] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:27.619266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed708c7a-9c71-43a5-b895-a967d36cdc96 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.619464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4c4e4-6df9-4562-975c-f8025f3d9976 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.621859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ed708c7a-9c71-43a5-b895-a967d36cdc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:27.625329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a3195-39b2-4a76-942e-84530d64b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.626150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a3195-39b2-4a76-942e-84530d64b538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.626500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a3195-39b2-4a76-942e-84530d64b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.626862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a3195-39b2-4a76-942e-84530d64b538 admin admin] PATH_INFO: `/v3/projects/b1e2b642d10a43afa1cdd6ca71f3d691/users/0a8d1e7e9e8b49a4bab89a5fd5045189/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.647245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a3195-39b2-4a76-942e-84530d64b538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e2b642d10a43afa1cdd6ca71f3d691, user_id=0a8d1e7e9e8b49a4bab89a5fd5045189, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.650118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a3195-39b2-4a76-942e-84530d64b538 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.666938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1054/2111] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:27 2022] PUT /identity/v3/projects/b1e2b642d10a43afa1cdd6ca71f3d691/users/0a8d1e7e9e8b49a4bab89a5fd5045189/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:27.670834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a3195-39b2-4a76-942e-84530d64b538 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.704743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed708c7a-9c71-43a5-b895-a967d36cdc96 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.729311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:27.752723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a3195-39b2-4a76-942e-84530d64b538 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.761491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd2fe8-a963-4e55-8e3e-cff0ec6c64b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.762181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2fe8-a963-4e55-8e3e-cff0ec6c64b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.762490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2fe8-a963-4e55-8e3e-cff0ec6c64b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.763079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd2fe8-a963-4e55-8e3e-cff0ec6c64b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.763416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd2fe8-a963-4e55-8e3e-cff0ec6c64b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.765088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd2fe8-a963-4e55-8e3e-cff0ec6c64b5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.776029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1055/2112] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:27.780194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd2fe8-a963-4e55-8e3e-cff0ec6c64b5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.783049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f9cef-775d-4e08-bd8c-4c83f3356d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.783673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9cef-775d-4e08-bd8c-4c83f3356d99 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.783958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9cef-775d-4e08-bd8c-4c83f3356d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.784236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f9cef-775d-4e08-bd8c-4c83f3356d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.792718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd2fe8-a963-4e55-8e3e-cff0ec6c64b5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:27.798687 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa20e7-b621-4bbb-a9f7-739be7c7d093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:27.799378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa20e7-b621-4bbb-a9f7-739be7c7d093 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.799666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa20e7-b621-4bbb-a9f7-739be7c7d093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.799952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa20e7-b621-4bbb-a9f7-739be7c7d093 admin admin] PATH_INFO: `/v3/projects/b1e2b642d10a43afa1cdd6ca71f3d691/users/0a8d1e7e9e8b49a4bab89a5fd5045189/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.802757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa20e7-b621-4bbb-a9f7-739be7c7d093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e2b642d10a43afa1cdd6ca71f3d691, user_id=0a8d1e7e9e8b49a4bab89a5fd5045189, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.805453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa20e7-b621-4bbb-a9f7-739be7c7d093 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.821609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1056/2113] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:27 2022] PUT /identity/v3/projects/b1e2b642d10a43afa1cdd6ca71f3d691/users/0a8d1e7e9e8b49a4bab89a5fd5045189/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:27.829088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80dc7-2cd7-4a04-89a6-9e146a2bc7d7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:27.829385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80dc7-2cd7-4a04-89a6-9e146a2bc7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:27.829709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda80dc7-2cd7-4a04-89a6-9e146a2bc7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:27.868702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cda80dc7-2cd7-4a04-89a6-9e146a2bc7d7 None None] MFA Rules not processed for user `0a8d1e7e9e8b49a4bab89a5fd5045189`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:27.869771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f9cef-775d-4e08-bd8c-4c83f3356d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:27.871402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f9cef-775d-4e08-bd8c-4c83f3356d99 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:27.876467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cda80dc7-2cd7-4a04-89a6-9e146a2bc7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:27.883450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1058/2114] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:27.970151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1057/2115] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:27.982127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f9cef-775d-4e08-bd8c-4c83f3356d99 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:27.991686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f9cef-775d-4e08-bd8c-4c83f3356d99 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:28.028491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:28.071705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0adf-e6dd-4e5e-a13f-df0e50b2610c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:28.073032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0adf-e6dd-4e5e-a13f-df0e50b2610c service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:28.073540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0adf-e6dd-4e5e-a13f-df0e50b2610c service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:28.074094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0adf-e6dd-4e5e-a13f-df0e50b2610c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:28.088277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec0adf-e6dd-4e5e-a13f-df0e50b2610c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:28.090072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec0adf-e6dd-4e5e-a13f-df0e50b2610c service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:28.121801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1059/2116] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:28.171054 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80dc7-2cd7-4a04-89a6-9e146a2bc7d7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:28.182888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda80dc7-2cd7-4a04-89a6-9e146a2bc7d7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:28.189225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7372a4-39f5-4077-9f94-7a2a86cb2380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:28.189990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7372a4-39f5-4077-9f94-7a2a86cb2380 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:28.190343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7372a4-39f5-4077-9f94-7a2a86cb2380 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:28.190690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7372a4-39f5-4077-9f94-7a2a86cb2380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:28.271536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7372a4-39f5-4077-9f94-7a2a86cb2380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:28.271885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7372a4-39f5-4077-9f94-7a2a86cb2380 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:28.282221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1058/2117] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:28.612026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0adf-e6dd-4e5e-a13f-df0e50b2610c service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:28.703945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0adf-e6dd-4e5e-a13f-df0e50b2610c service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:28.709143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:28.709996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:28.710234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:28.710554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] PATH_INFO: `/v3/users/3077314a17a84a6196e054d2dcd59fd2` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:28.711826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3077314a17a84a6196e054d2dcd59fd2)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:28.713946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:28.767998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3077314a17a84a6196e054d2dcd59fd2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:28.775917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3077314a17a84a6196e054d2dcd59fd2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:28.776656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3077314a17a84a6196e054d2dcd59fd2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:28.777276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3077314a17a84a6196e054d2dcd59fd2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:28.785870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3077314a17a84a6196e054d2dcd59fd2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:28.806209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1060/2118] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:28 2022] DELETE /identity/v3/users/3077314a17a84a6196e054d2dcd59fd2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:28.811004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396a94-1a25-4fef-ba4a-4b380f8532d5 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:28.811291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396a94-1a25-4fef-ba4a-4b380f8532d5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:28.811565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396a94-1a25-4fef-ba4a-4b380f8532d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:28.831534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d7396a94-1a25-4fef-ba4a-4b380f8532d5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:28.833073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d7396a94-1a25-4fef-ba4a-4b380f8532d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:28.880543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:28.902073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1059/2119] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:28.918318 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:28.919822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:28.982545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5f7da-dc62-4d71-8472-01038687793f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:28.986331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b26cc-9abe-4595-a82d-83ab7b8c96b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:28.986925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b26cc-9abe-4595-a82d-83ab7b8c96b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:28.987122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b26cc-9abe-4595-a82d-83ab7b8c96b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:28.987395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b26cc-9abe-4595-a82d-83ab7b8c96b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:28.996361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:28.999225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b26cc-9abe-4595-a82d-83ab7b8c96b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:29.000866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b26cc-9abe-4595-a82d-83ab7b8c96b8 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:29.014688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1061/2120] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:29.401157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396a94-1a25-4fef-ba4a-4b380f8532d5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:29.403317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d7396a94-1a25-4fef-ba4a-4b380f8532d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:29.423140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396a94-1a25-4fef-ba4a-4b380f8532d5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:29.429724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:29.430382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:29.430666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:29.430951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] PATH_INFO: `/v3/projects/5245835207cc4f1080896bdba410bffe` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:29.432589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5245835207cc4f1080896bdba410bffe)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:29.434116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:29.504344 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5245835207cc4f1080896bdba410bffe', 'request_id': 'req-75afc272-5619-4410-b558-9c77beab06d3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.515742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5245835207cc4f1080896bdba410bffe', 'request_id': 'req-75afc272-5619-4410-b558-9c77beab06d3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.524195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5245835207cc4f1080896bdba410bffe', 'request_id': 'req-75afc272-5619-4410-b558-9c77beab06d3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.536176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] The token cache is being invalidate because project 5245835207cc4f1080896bdba410bffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:29.536479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.537184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.543567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b26cc-9abe-4595-a82d-83ab7b8c96b8 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:29.544144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1060/2121] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:29 2022] DELETE /identity/v3/projects/5245835207cc4f1080896bdba410bffe => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:29.554000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b26cc-9abe-4595-a82d-83ab7b8c96b8 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:29.611586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:29.612293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:29.612616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:29.612899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] PATH_INFO: `/v3/users/65de74f1c2344742a67e00df1cb05323` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:29.614103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65de74f1c2344742a67e00df1cb05323)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:29.615989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:29.670059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65de74f1c2344742a67e00df1cb05323'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.681338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65de74f1c2344742a67e00df1cb05323'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.682791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65de74f1c2344742a67e00df1cb05323'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.683476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65de74f1c2344742a67e00df1cb05323'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.693889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0988b2ef-65af-4a98-aac3-67e41b21f2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65de74f1c2344742a67e00df1cb05323'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:29.713477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1062/2122] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:29 2022] DELETE /identity/v3/users/65de74f1c2344742a67e00df1cb05323 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:30.048322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:30.050435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:30.067416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afc272-5619-4410-b558-9c77beab06d3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:30.157543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:30.158487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.158902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.159316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] PATH_INFO: `/v3/projects/10a3ca9ce1ba48298b82abd20dbda904` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.161167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a3ca9ce1ba48298b82abd20dbda904)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:30.169789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:30.273920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a3ca9ce1ba48298b82abd20dbda904', 'request_id': 'req-91e4f2e5-d412-4969-9af9-cb25568e1bd1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:30.286388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a3ca9ce1ba48298b82abd20dbda904', 'request_id': 'req-91e4f2e5-d412-4969-9af9-cb25568e1bd1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:30.298827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a3ca9ce1ba48298b82abd20dbda904', 'request_id': 'req-91e4f2e5-d412-4969-9af9-cb25568e1bd1'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:30.309429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:30.314704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] The token cache is being invalidate because project 10a3ca9ce1ba48298b82abd20dbda904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:30.315910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:30.317070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-91e4f2e5-d412-4969-9af9-cb25568e1bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:30.319090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1061/2123] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:30 2022] DELETE /identity/v3/projects/10a3ca9ce1ba48298b82abd20dbda904 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:30.325116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4c3dc-58ea-4234-895f-852cfaf134fa None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.325651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4c3dc-58ea-4234-895f-852cfaf134fa None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.326021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4c3dc-58ea-4234-895f-852cfaf134fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.366838 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6bd4c3dc-58ea-4234-895f-852cfaf134fa None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:30.368129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6bd4c3dc-58ea-4234-895f-852cfaf134fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:30.438508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1063/2124] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:30.446117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ffb6c-61f6-4674-947e-bbf01e97bfd4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.446479 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ffb6c-61f6-4674-947e-bbf01e97bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.446766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ffb6c-61f6-4674-947e-bbf01e97bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.469015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2d0ffb6c-61f6-4674-947e-bbf01e97bfd4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:30.470397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2d0ffb6c-61f6-4674-947e-bbf01e97bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:30.479249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1062/2125] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:30.484060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4c3dc-58ea-4234-895f-852cfaf134fa None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:30.494949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4c3dc-58ea-4234-895f-852cfaf134fa None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:30.499804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:30.500470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.500759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.501036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.501748 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:30.502061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:30.503684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:30.519366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1064/2126] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:30.524289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ffb6c-61f6-4674-947e-bbf01e97bfd4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:30.534079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ffb6c-61f6-4674-947e-bbf01e97bfd4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:30.539760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34127-97ce-4d7b-a3f2-0d28f3d1050a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:30.540383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34127-97ce-4d7b-a3f2-0d28f3d1050a admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.540664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34127-97ce-4d7b-a3f2-0d28f3d1050a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.543823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34127-97ce-4d7b-a3f2-0d28f3d1050a admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.543823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34127-97ce-4d7b-a3f2-0d28f3d1050a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:30.543823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34127-97ce-4d7b-a3f2-0d28f3d1050a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:30.572893 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1063/2127] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:30 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:30.577475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:30.583639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:30.592743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004c247-c117-47f6-a930-dcbe24330e6d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:30.662320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1752a47-f58f-4b2d-958d-173259255606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:30.662978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752a47-f58f-4b2d-958d-173259255606 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.663262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752a47-f58f-4b2d-958d-173259255606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.663539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752a47-f58f-4b2d-958d-173259255606 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.664232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1752a47-f58f-4b2d-958d-173259255606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:30.666269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1752a47-f58f-4b2d-958d-173259255606 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:30.689351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1065/2128] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:30 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:30.694655 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34127-97ce-4d7b-a3f2-0d28f3d1050a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:30.716117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34127-97ce-4d7b-a3f2-0d28f3d1050a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:30.721311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d368b1-7f00-4bac-9165-08266feaf968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:30.722103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d368b1-7f00-4bac-9165-08266feaf968 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.722490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d368b1-7f00-4bac-9165-08266feaf968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.722883 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d368b1-7f00-4bac-9165-08266feaf968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.723629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d368b1-7f00-4bac-9165-08266feaf968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:30.725326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d368b1-7f00-4bac-9165-08266feaf968 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:30.739468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1064/2129] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:30.740706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1752a47-f58f-4b2d-958d-173259255606 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:30.756943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1752a47-f58f-4b2d-958d-173259255606 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:30.769741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c713f1-bc10-4a50-b59a-de3d21429148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:30.770391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c713f1-bc10-4a50-b59a-de3d21429148 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.770675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c713f1-bc10-4a50-b59a-de3d21429148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.770968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c713f1-bc10-4a50-b59a-de3d21429148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.771600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c713f1-bc10-4a50-b59a-de3d21429148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:30.773222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c713f1-bc10-4a50-b59a-de3d21429148 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:30.785071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1066/2130] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:30.789450 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d368b1-7f00-4bac-9165-08266feaf968 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:30.799464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d368b1-7f00-4bac-9165-08266feaf968 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:30.804071 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14150e-04f3-443d-87bd-6900ddf315d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:30.804740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14150e-04f3-443d-87bd-6900ddf315d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.805024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14150e-04f3-443d-87bd-6900ddf315d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.805887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14150e-04f3-443d-87bd-6900ddf315d3 admin admin] PATH_INFO: `/v3/projects/00e050db0de74f878a58294aba7f5809/users/bcb5497bf13248d6a8fe5441255f58b2/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.820860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14150e-04f3-443d-87bd-6900ddf315d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e050db0de74f878a58294aba7f5809, user_id=bcb5497bf13248d6a8fe5441255f58b2, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:30.823593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14150e-04f3-443d-87bd-6900ddf315d3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:30.838349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1065/2131] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:30 2022] PUT /identity/v3/projects/00e050db0de74f878a58294aba7f5809/users/bcb5497bf13248d6a8fe5441255f58b2/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:30.848865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba33c4-d2ea-4152-9fa9-1c14e08cb74c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:30.849156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba33c4-d2ea-4152-9fa9-1c14e08cb74c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:30.849437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba33c4-d2ea-4152-9fa9-1c14e08cb74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:30.880342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-1aba33c4-d2ea-4152-9fa9-1c14e08cb74c None None] MFA Rules not processed for user `bcb5497bf13248d6a8fe5441255f58b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:30.881607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1aba33c4-d2ea-4152-9fa9-1c14e08cb74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:30.962570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1067/2132] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:30.967788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14150e-04f3-443d-87bd-6900ddf315d3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:31.036327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14150e-04f3-443d-87bd-6900ddf315d3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:31.041852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca412007-3e8a-4123-be54-b4db5d1af6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:31.042513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412007-3e8a-4123-be54-b4db5d1af6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.042807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412007-3e8a-4123-be54-b4db5d1af6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.043083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca412007-3e8a-4123-be54-b4db5d1af6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.043734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca412007-3e8a-4123-be54-b4db5d1af6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:31.045710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca412007-3e8a-4123-be54-b4db5d1af6f6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:31.076786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1066/2133] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:30 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:31.081470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba33c4-d2ea-4152-9fa9-1c14e08cb74c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:31.093427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba33c4-d2ea-4152-9fa9-1c14e08cb74c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:31.156443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8dc6a-a4c6-431f-a96d-4860d52adb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:31.157309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8dc6a-a4c6-431f-a96d-4860d52adb36 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.157632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8dc6a-a4c6-431f-a96d-4860d52adb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.157912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8dc6a-a4c6-431f-a96d-4860d52adb36 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.158572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8dc6a-a4c6-431f-a96d-4860d52adb36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:31.160972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8dc6a-a4c6-431f-a96d-4860d52adb36 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:31.181524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:31.191312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1068/2134] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:31 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:31.196574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca412007-3e8a-4123-be54-b4db5d1af6f6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:31.207307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca412007-3e8a-4123-be54-b4db5d1af6f6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:31.212470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc5f1-f564-4ba0-83c7-449a6cab7245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:31.213188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc5f1-f564-4ba0-83c7-449a6cab7245 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.213594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc5f1-f564-4ba0-83c7-449a6cab7245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.213942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efc5f1-f564-4ba0-83c7-449a6cab7245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.214667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efc5f1-f564-4ba0-83c7-449a6cab7245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:31.216348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efc5f1-f564-4ba0-83c7-449a6cab7245 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:31.228400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1067/2135] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:31.232545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8dc6a-a4c6-431f-a96d-4860d52adb36 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:31.243888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8dc6a-a4c6-431f-a96d-4860d52adb36 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:31.249101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:31.249401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.249720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.249995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] PATH_INFO: `/v3/projects/cf920860b786482296e88b44b3709f61/users/b92ca8b8433a4dfc9e1e061334bf292f/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.270655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf920860b786482296e88b44b3709f61, user_id=b92ca8b8433a4dfc9e1e061334bf292f, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:31.273638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:31.289628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1069/2136] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:31 2022] PUT /identity/v3/projects/cf920860b786482296e88b44b3709f61/users/b92ca8b8433a4dfc9e1e061334bf292f/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:31.293939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc5f1-f564-4ba0-83c7-449a6cab7245 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:31.315800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efc5f1-f564-4ba0-83c7-449a6cab7245 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:31.389995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:31.395522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:31.422606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e920c6-127e-4058-835f-b4478e018121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:31.423378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e920c6-127e-4058-835f-b4478e018121 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.423765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e920c6-127e-4058-835f-b4478e018121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.424219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e920c6-127e-4058-835f-b4478e018121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.424965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e920c6-127e-4058-835f-b4478e018121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:31.426828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e920c6-127e-4058-835f-b4478e018121 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:31.439371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1068/2137] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:31 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:31.443084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e920c6-127e-4058-835f-b4478e018121 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:31.454092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e920c6-127e-4058-835f-b4478e018121 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:31.460322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b06439-156b-4e30-85df-994d68eebbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:31.460918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b06439-156b-4e30-85df-994d68eebbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.461211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b06439-156b-4e30-85df-994d68eebbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.461508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b06439-156b-4e30-85df-994d68eebbaa admin admin] PATH_INFO: `/v3/projects/cf920860b786482296e88b44b3709f61/users/b92ca8b8433a4dfc9e1e061334bf292f/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.463689 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b06439-156b-4e30-85df-994d68eebbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf920860b786482296e88b44b3709f61, user_id=b92ca8b8433a4dfc9e1e061334bf292f, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:31.467170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b06439-156b-4e30-85df-994d68eebbaa admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:31.469673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:31.482443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1069/2138] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:31 2022] PUT /identity/v3/projects/cf920860b786482296e88b44b3709f61/users/b92ca8b8433a4dfc9e1e061334bf292f/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:31.510242 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb46f-87c9-49f4-b7c2-7d2bdf28f9a6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:31.553991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbf73c-68e8-40d4-bfd3-9b885ee27e08 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.554274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbf73c-68e8-40d4-bfd3-9b885ee27e08 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.554547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbf73c-68e8-40d4-bfd3-9b885ee27e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.599822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-87dbf73c-68e8-40d4-bfd3-9b885ee27e08 None None] MFA Rules not processed for user `b92ca8b8433a4dfc9e1e061334bf292f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:31.601081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-87dbf73c-68e8-40d4-bfd3-9b885ee27e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:31.604087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:31.604856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.605475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.607014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] PATH_INFO: `/v3/users/766200ec3bbb40a8967e5182eb9b864f` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.609241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766200ec3bbb40a8967e5182eb9b864f)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:31.615391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:31.708252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1070/2139] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:31.715912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766200ec3bbb40a8967e5182eb9b864f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:31.718678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbf73c-68e8-40d4-bfd3-9b885ee27e08 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:31.720832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-87dbf73c-68e8-40d4-bfd3-9b885ee27e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:31.733458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766200ec3bbb40a8967e5182eb9b864f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:31.734366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766200ec3bbb40a8967e5182eb9b864f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:31.735103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766200ec3bbb40a8967e5182eb9b864f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:31.747659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2f02daac-a1e5-46c2-8f4e-378a71e883f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766200ec3bbb40a8967e5182eb9b864f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:31.788787 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1070/2140] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:31 2022] DELETE /identity/v3/users/766200ec3bbb40a8967e5182eb9b864f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:31.793973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d639a6-36c5-4c38-8d98-55919bebec24 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.794378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d639a6-36c5-4c38-8d98-55919bebec24 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.795516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d639a6-36c5-4c38-8d98-55919bebec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.806517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:31.829577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-41d639a6-36c5-4c38-8d98-55919bebec24 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:31.831174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-41d639a6-36c5-4c38-8d98-55919bebec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:31.858201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbf73c-68e8-40d4-bfd3-9b885ee27e08 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:31.969720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:31.970701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:31.971211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:31.971683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:31.974207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:32.000396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1071/2141] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:32.011561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d639a6-36c5-4c38-8d98-55919bebec24 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:32.026528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-41d639a6-36c5-4c38-8d98-55919bebec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:32.115168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:32.131558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d639a6-36c5-4c38-8d98-55919bebec24 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:32.136966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:32.137678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:32.137903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:32.138190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:32.162881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:32.163118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:32.163250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:32.164413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:32.176345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1071/2142] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:32.176916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1072/2143] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:32.730074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:32.731516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:32.751975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5a729-5926-4bbe-aa64-2821bdd7421f service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:32.762981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:32.764361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:32.764746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:32.765141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] PATH_INFO: `/v3/projects/01ad107a181b4e46a63d93a8fa89889a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:32.766636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ad107a181b4e46a63d93a8fa89889a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:32.769676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:32.832909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ad107a181b4e46a63d93a8fa89889a', 'request_id': 'req-c72dc466-3eb9-4476-b29f-6938afb7c2fd'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:32.856751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:32.856751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:32.857577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ad107a181b4e46a63d93a8fa89889a', 'request_id': 'req-c72dc466-3eb9-4476-b29f-6938afb7c2fd'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:32.860478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ad107a181b4e46a63d93a8fa89889a', 'request_id': 'req-c72dc466-3eb9-4476-b29f-6938afb7c2fd'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:32.861954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb403e2-7ae1-4e3a-9d56-3c7debf8faaa service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:32.879039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] The token cache is being invalidate because project 01ad107a181b4e46a63d93a8fa89889a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:32.879039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:32.879720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:32.881460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1072/2144] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:32 2022] DELETE /identity/v3/projects/01ad107a181b4e46a63d93a8fa89889a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:32.885434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:32.886822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:32.935672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:32.936461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:32.936750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:32.936983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] PATH_INFO: `/v3/users/bcb5497bf13248d6a8fe5441255f58b2` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:32.938150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb5497bf13248d6a8fe5441255f58b2)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:32.940112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:32.965775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dc466-3eb9-4476-b29f-6938afb7c2fd admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:32.971354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:32.971991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:32.972376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:32.972714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] PATH_INFO: `/v3/users/9d0bbe091f1f48a1bfcf3bafa6408448` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:32.974357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0bbe091f1f48a1bfcf3bafa6408448)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:32.976316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:32.998421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb5497bf13248d6a8fe5441255f58b2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:32.999925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:33.010468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb5497bf13248d6a8fe5441255f58b2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.011780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb5497bf13248d6a8fe5441255f58b2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.012458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb5497bf13248d6a8fe5441255f58b2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.023607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fee7a274-c823-4408-8849-39f247114901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb5497bf13248d6a8fe5441255f58b2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.031161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0bbe091f1f48a1bfcf3bafa6408448'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.032520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0bbe091f1f48a1bfcf3bafa6408448'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.041170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0bbe091f1f48a1bfcf3bafa6408448'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.042419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0bbe091f1f48a1bfcf3bafa6408448'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.046764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1073/2145] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:32 2022] DELETE /identity/v3/users/bcb5497bf13248d6a8fe5441255f58b2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:33.054065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672757-961e-4f27-890f-b0f467a7b1fc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:33.054546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672757-961e-4f27-890f-b0f467a7b1fc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:33.054760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672757-961e-4f27-890f-b0f467a7b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:33.056470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0bbe091f1f48a1bfcf3bafa6408448'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.063120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:33.081033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-88672757-961e-4f27-890f-b0f467a7b1fc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:33.082463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-88672757-961e-4f27-890f-b0f467a7b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:33.082888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1073/2146] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:32 2022] DELETE /identity/v3/users/9d0bbe091f1f48a1bfcf3bafa6408448 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:33.174186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1074/2147] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:33.190942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:33.194897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:33.267980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000084e3-c9c6-4ec6-bcef-3600a2e7baea admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:33.273150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b045-4b01-4868-8a19-64af7aca5079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:33.274434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b045-4b01-4868-8a19-64af7aca5079 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:33.274637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b045-4b01-4868-8a19-64af7aca5079 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:33.275573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b045-4b01-4868-8a19-64af7aca5079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:33.290249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b045-4b01-4868-8a19-64af7aca5079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:33.291943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b045-4b01-4868-8a19-64af7aca5079 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:33.303538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1074/2148] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:33.437276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88672757-961e-4f27-890f-b0f467a7b1fc None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:33.439342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-88672757-961e-4f27-890f-b0f467a7b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:33.481081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88672757-961e-4f27-890f-b0f467a7b1fc None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:33.486189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:33.486986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:33.487360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:33.487711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] PATH_INFO: `/v3/projects/076182300d334be7b50b66b306af161a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:33.488933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076182300d334be7b50b66b306af161a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:33.491448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:33.568725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076182300d334be7b50b66b306af161a', 'request_id': 'req-83531b8e-42c3-41b8-af86-78a99f2982f6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.583003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076182300d334be7b50b66b306af161a', 'request_id': 'req-83531b8e-42c3-41b8-af86-78a99f2982f6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.591577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076182300d334be7b50b66b306af161a', 'request_id': 'req-83531b8e-42c3-41b8-af86-78a99f2982f6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.603311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] The token cache is being invalidate because project 076182300d334be7b50b66b306af161a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:33.603745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.604501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.606258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1075/2149] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:33 2022] DELETE /identity/v3/projects/076182300d334be7b50b66b306af161a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:33.610572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b045-4b01-4868-8a19-64af7aca5079 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:33.623060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b045-4b01-4868-8a19-64af7aca5079 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:33.626496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:33.628161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:33.687651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:33.703497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:33.704249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:33.704600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:33.704944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] PATH_INFO: `/v3/users/0a8d1e7e9e8b49a4bab89a5fd5045189` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:33.707627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8d1e7e9e8b49a4bab89a5fd5045189)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:33.710020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:33.712112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83531b8e-42c3-41b8-af86-78a99f2982f6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:33.719817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:33.720650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:33.720943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:33.721238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] PATH_INFO: `/v3/projects/00e050db0de74f878a58294aba7f5809` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:33.723772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e050db0de74f878a58294aba7f5809)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:33.726459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:33.771689 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8d1e7e9e8b49a4bab89a5fd5045189'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.772569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8d1e7e9e8b49a4bab89a5fd5045189'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.783380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8d1e7e9e8b49a4bab89a5fd5045189'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.784204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8d1e7e9e8b49a4bab89a5fd5045189'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.795283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e050db0de74f878a58294aba7f5809', 'request_id': 'req-362902d6-c27b-47e2-bcc1-522222e29fc0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.795582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8d1e7e9e8b49a4bab89a5fd5045189'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.815746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e050db0de74f878a58294aba7f5809', 'request_id': 'req-362902d6-c27b-47e2-bcc1-522222e29fc0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.821700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1075/2150] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:33 2022] DELETE /identity/v3/users/0a8d1e7e9e8b49a4bab89a5fd5045189 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:33.837160 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e050db0de74f878a58294aba7f5809', 'request_id': 'req-362902d6-c27b-47e2-bcc1-522222e29fc0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.851326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] The token cache is being invalidate because project 00e050db0de74f878a58294aba7f5809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:33.852535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.853399 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:33.858066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1076/2151] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:33 2022] DELETE /identity/v3/projects/00e050db0de74f878a58294aba7f5809 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:33.859467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:33.861392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:33.892049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:33.990472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeaefd4-5fc4-4770-800a-4b44cb8a4324 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:33.997172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:33.997890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:33.998175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:33.998459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] PATH_INFO: `/v3/users/b92ca8b8433a4dfc9e1e061334bf292f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:33.999638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92ca8b8433a4dfc9e1e061334bf292f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:34.001612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:34.071294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92ca8b8433a4dfc9e1e061334bf292f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.071919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92ca8b8433a4dfc9e1e061334bf292f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.080679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92ca8b8433a4dfc9e1e061334bf292f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.081622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92ca8b8433a4dfc9e1e061334bf292f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.091459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92ca8b8433a4dfc9e1e061334bf292f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.114967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1076/2152] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:33 2022] DELETE /identity/v3/users/b92ca8b8433a4dfc9e1e061334bf292f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:34.218600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:34.219927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:34.312393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362902d6-c27b-47e2-bcc1-522222e29fc0 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:34.391462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:34.392678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.392678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.392678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] PATH_INFO: `/v3/projects/b1e2b642d10a43afa1cdd6ca71f3d691` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.393903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e2b642d10a43afa1cdd6ca71f3d691)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:34.397982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:34.437353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:34.441379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:34.442535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:34.475022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e2b642d10a43afa1cdd6ca71f3d691', 'request_id': 'req-3532c39e-e120-414a-9208-d8284bef8ad6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.489141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e2b642d10a43afa1cdd6ca71f3d691', 'request_id': 'req-3532c39e-e120-414a-9208-d8284bef8ad6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.489756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2042f-f82a-4439-b73e-5459cd2f8cda admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:34.501112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e2b642d10a43afa1cdd6ca71f3d691', 'request_id': 'req-3532c39e-e120-414a-9208-d8284bef8ad6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.515424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] The token cache is being invalidate because project b1e2b642d10a43afa1cdd6ca71f3d691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:34.515720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.516411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3532c39e-e120-414a-9208-d8284bef8ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.518949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1077/2153] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:34 2022] DELETE /identity/v3/projects/b1e2b642d10a43afa1cdd6ca71f3d691 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:34.525292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d826b-72fd-4b0c-9a72-e1e073003f4e None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.525724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d826b-72fd-4b0c-9a72-e1e073003f4e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.526080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d826b-72fd-4b0c-9a72-e1e073003f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.547047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-893d826b-72fd-4b0c-9a72-e1e073003f4e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:34.548537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-893d826b-72fd-4b0c-9a72-e1e073003f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:34.569200 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:34.569989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.570856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.571841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] PATH_INFO: `/v3/projects/cf920860b786482296e88b44b3709f61` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.572639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf920860b786482296e88b44b3709f61)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:34.574830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:34.616375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:34.624775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1078/2154] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:34.632313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf920860b786482296e88b44b3709f61', 'request_id': 'req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.636925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb76f48-ba0c-4256-a183-64ca863084d9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.637215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb76f48-ba0c-4256-a183-64ca863084d9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.637540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb76f48-ba0c-4256-a183-64ca863084d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.643417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf920860b786482296e88b44b3709f61', 'request_id': 'req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.651858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf920860b786482296e88b44b3709f61', 'request_id': 'req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.663796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] The token cache is being invalidate because project cf920860b786482296e88b44b3709f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:34.664030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-9eb76f48-ba0c-4256-a183-64ca863084d9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:34.664135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.664770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ba905d24-2f9d-435d-afb3-6edbaf67e0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:34.665642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9eb76f48-ba0c-4256-a183-64ca863084d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:34.666412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1077/2155] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:34 2022] DELETE /identity/v3/projects/cf920860b786482296e88b44b3709f61 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:34.675367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d35bf-77ee-4fe9-b742-9128815bd180 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.675755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d35bf-77ee-4fe9-b742-9128815bd180 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.676629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d35bf-77ee-4fe9-b742-9128815bd180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.702858 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f77d35bf-77ee-4fe9-b742-9128815bd180 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:34.704784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f77d35bf-77ee-4fe9-b742-9128815bd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:34.781310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1079/2156] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:34.786160 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb76f48-ba0c-4256-a183-64ca863084d9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:34.795978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1078/2157] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:34.796320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb76f48-ba0c-4256-a183-64ca863084d9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:34.802537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:34.803328 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.803598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.803970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.804158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8353d-1bec-4ac8-9037-fc371006ac93 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.804322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8353d-1bec-4ac8-9037-fc371006ac93 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.804525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8353d-1bec-4ac8-9037-fc371006ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.805493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:34.805896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:34.808067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:34.823848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1080/2158] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:34.826663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f5b8353d-1bec-4ac8-9037-fc371006ac93 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:34.827914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f5b8353d-1bec-4ac8-9037-fc371006ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:34.829031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:34.837320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1079/2159] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:34.841745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8353d-1bec-4ac8-9037-fc371006ac93 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:34.843750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab7950-3564-4ef8-881b-e5ec20e8edf2 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:34.849850 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187791f-99ed-4312-b9ff-05a6e95d2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:34.850483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187791f-99ed-4312-b9ff-05a6e95d2f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.850768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187791f-99ed-4312-b9ff-05a6e95d2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.851045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187791f-99ed-4312-b9ff-05a6e95d2f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.851564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8353d-1bec-4ac8-9037-fc371006ac93 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:34.851825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187791f-99ed-4312-b9ff-05a6e95d2f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:34.853759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187791f-99ed-4312-b9ff-05a6e95d2f6b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:34.856583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:34.857234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.857488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.857798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.858453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:34.858767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:34.860371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:34.885369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1080/2160] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:40:34.887238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:34.898073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabb605-5bc5-40fb-8b66-1e0d1f790ac5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:34.902445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1081/2161] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:34 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:34.903214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d79ff-c87d-498c-92e8-45125b6daab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:34.903853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d79ff-c87d-498c-92e8-45125b6daab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:34.904136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d79ff-c87d-498c-92e8-45125b6daab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:34.904414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d79ff-c87d-498c-92e8-45125b6daab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:34.905084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d79ff-c87d-498c-92e8-45125b6daab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:34.907153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d79ff-c87d-498c-92e8-45125b6daab4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:34.907349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187791f-99ed-4312-b9ff-05a6e95d2f6b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:34.951298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:34.954426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1081/2162] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:34 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:34.960032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d79ff-c87d-498c-92e8-45125b6daab4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.026482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187791f-99ed-4312-b9ff-05a6e95d2f6b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.068895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d79ff-c87d-498c-92e8-45125b6daab4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.075866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364905ca-3e55-4adf-8068-ea6c92101c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.076513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364905ca-3e55-4adf-8068-ea6c92101c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.076798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364905ca-3e55-4adf-8068-ea6c92101c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.077075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364905ca-3e55-4adf-8068-ea6c92101c6f admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.078238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364905ca-3e55-4adf-8068-ea6c92101c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.082224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364905ca-3e55-4adf-8068-ea6c92101c6f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.113570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1082/2163] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:34 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:35.117724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364905ca-3e55-4adf-8068-ea6c92101c6f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.133314 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364905ca-3e55-4adf-8068-ea6c92101c6f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.139030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6654cf7-1def-423a-aff3-49ea835050e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.139789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654cf7-1def-423a-aff3-49ea835050e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.140149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654cf7-1def-423a-aff3-49ea835050e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.140504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6654cf7-1def-423a-aff3-49ea835050e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.141568 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6654cf7-1def-423a-aff3-49ea835050e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.143134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6654cf7-1def-423a-aff3-49ea835050e9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.144765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:35.164335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1083/2164] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:35.165472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6654cf7-1def-423a-aff3-49ea835050e9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.177625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6654cf7-1def-423a-aff3-49ea835050e9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.182966 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cda391-6ca3-4914-b5e2-2b8628efef6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.183554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787d993-5edb-48fb-b99b-1557e7e0deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.183731 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda391-6ca3-4914-b5e2-2b8628efef6d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.183922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda391-6ca3-4914-b5e2-2b8628efef6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.184511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d993-5edb-48fb-b99b-1557e7e0deb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.184723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cda391-6ca3-4914-b5e2-2b8628efef6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.184943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d993-5edb-48fb-b99b-1557e7e0deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.185412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d993-5edb-48fb-b99b-1557e7e0deb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.185653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cda391-6ca3-4914-b5e2-2b8628efef6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.186468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787d993-5edb-48fb-b99b-1557e7e0deb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.187356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cda391-6ca3-4914-b5e2-2b8628efef6d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.189799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787d993-5edb-48fb-b99b-1557e7e0deb2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.205583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1084/2165] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:35.211780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cda391-6ca3-4914-b5e2-2b8628efef6d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.226231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cda391-6ca3-4914-b5e2-2b8628efef6d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.235164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039949bc-f48c-4dfc-8f18-1102cc998c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.235922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039949bc-f48c-4dfc-8f18-1102cc998c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.236209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039949bc-f48c-4dfc-8f18-1102cc998c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.236490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039949bc-f48c-4dfc-8f18-1102cc998c7e admin admin] PATH_INFO: `/v3/projects/ea853d3d8f2b4ca59b26148b79d523d8/users/a8c35f1fd7614b5598881c7f1c346cc0/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.241232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1082/2166] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:34 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:35.243529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787d993-5edb-48fb-b99b-1557e7e0deb2 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.256584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039949bc-f48c-4dfc-8f18-1102cc998c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea853d3d8f2b4ca59b26148b79d523d8, user_id=a8c35f1fd7614b5598881c7f1c346cc0, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.260579 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039949bc-f48c-4dfc-8f18-1102cc998c7e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.279226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787d993-5edb-48fb-b99b-1557e7e0deb2 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.280178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1085/2167] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:35 2022] PUT /identity/v3/projects/ea853d3d8f2b4ca59b26148b79d523d8/users/a8c35f1fd7614b5598881c7f1c346cc0/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:35.292184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3a949-7d0d-4a09-8d61-4fcef4cb4963 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.292526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3a949-7d0d-4a09-8d61-4fcef4cb4963 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.292780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3a949-7d0d-4a09-8d61-4fcef4cb4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.345779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b6a3a949-7d0d-4a09-8d61-4fcef4cb4963 None None] MFA Rules not processed for user `a8c35f1fd7614b5598881c7f1c346cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:35.347047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b6a3a949-7d0d-4a09-8d61-4fcef4cb4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:35.367369 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a586114-2e00-479c-a9ea-55410d54c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.368658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a586114-2e00-479c-a9ea-55410d54c982 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.370516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a586114-2e00-479c-a9ea-55410d54c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.371156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a586114-2e00-479c-a9ea-55410d54c982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.372476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a586114-2e00-479c-a9ea-55410d54c982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.375990 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a586114-2e00-479c-a9ea-55410d54c982 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.399321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1083/2168] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:35.400743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a586114-2e00-479c-a9ea-55410d54c982 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.414568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a586114-2e00-479c-a9ea-55410d54c982 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.420959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bec7fb-9d5c-4ab0-82b9-f359a2511b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.421636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec7fb-9d5c-4ab0-82b9-f359a2511b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.421935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec7fb-9d5c-4ab0-82b9-f359a2511b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.422217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec7fb-9d5c-4ab0-82b9-f359a2511b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.422886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bec7fb-9d5c-4ab0-82b9-f359a2511b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.424662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bec7fb-9d5c-4ab0-82b9-f359a2511b85 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.440013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1084/2169] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:35.441308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bec7fb-9d5c-4ab0-82b9-f359a2511b85 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.456078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bec7fb-9d5c-4ab0-82b9-f359a2511b85 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.459341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1086/2170] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:35.466768 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131c5c-1bf4-4d27-815d-16356eecbcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.467539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131c5c-1bf4-4d27-815d-16356eecbcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.467904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131c5c-1bf4-4d27-815d-16356eecbcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.468363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131c5c-1bf4-4d27-815d-16356eecbcc3 admin admin] PATH_INFO: `/v3/projects/a1fce34c883b4cdca76b5ad9ee793b54/users/a7b603dbe0514addadee439ac80c8c3e/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.471092 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3a949-7d0d-4a09-8d61-4fcef4cb4963 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.472723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b6a3a949-7d0d-4a09-8d61-4fcef4cb4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:35.488327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86131c5c-1bf4-4d27-815d-16356eecbcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fce34c883b4cdca76b5ad9ee793b54, user_id=a7b603dbe0514addadee439ac80c8c3e, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.491306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86131c5c-1bf4-4d27-815d-16356eecbcc3 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.517917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1085/2171] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:35 2022] PUT /identity/v3/projects/a1fce34c883b4cdca76b5ad9ee793b54/users/a7b603dbe0514addadee439ac80c8c3e/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:35.524849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29566a6f-5a5c-475e-b850-89a3f6da9e71 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.525263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29566a6f-5a5c-475e-b850-89a3f6da9e71 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.525397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29566a6f-5a5c-475e-b850-89a3f6da9e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.578924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-29566a6f-5a5c-475e-b850-89a3f6da9e71 None None] MFA Rules not processed for user `a7b603dbe0514addadee439ac80c8c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:35.579167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3a949-7d0d-4a09-8d61-4fcef4cb4963 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.583058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-29566a6f-5a5c-475e-b850-89a3f6da9e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:35.598439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:35.676559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1086/2172] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:35.696949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02025224-e171-43e3-9b10-7b40d031b939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.697813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02025224-e171-43e3-9b10-7b40d031b939 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.698079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02025224-e171-43e3-9b10-7b40d031b939 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.698645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02025224-e171-43e3-9b10-7b40d031b939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.727770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:35.789904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02025224-e171-43e3-9b10-7b40d031b939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.791349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02025224-e171-43e3-9b10-7b40d031b939 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.801292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1087/2173] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:35.816946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29566a6f-5a5c-475e-b850-89a3f6da9e71 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.825696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02025224-e171-43e3-9b10-7b40d031b939 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.827613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29566a6f-5a5c-475e-b850-89a3f6da9e71 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.831510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700030a-aa62-448e-ba5b-ba6e37f9bcba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.832130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700030a-aa62-448e-ba5b-ba6e37f9bcba service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.832408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700030a-aa62-448e-ba5b-ba6e37f9bcba service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.832681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700030a-aa62-448e-ba5b-ba6e37f9bcba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.842221 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700030a-aa62-448e-ba5b-ba6e37f9bcba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.843788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700030a-aa62-448e-ba5b-ba6e37f9bcba service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.859903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1087/2174] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:35.883227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700030a-aa62-448e-ba5b-ba6e37f9bcba service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:35.929117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02025224-e171-43e3-9b10-7b40d031b939 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.934119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.935004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.935289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.935573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] PATH_INFO: `/v3/users/a8c35f1fd7614b5598881c7f1c346cc0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.936765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c35f1fd7614b5598881c7f1c346cc0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:35.938752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:35.987159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700030a-aa62-448e-ba5b-ba6e37f9bcba service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:35.995641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:35.996307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:35.996591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:35.996874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] PATH_INFO: `/v3/users/a7b603dbe0514addadee439ac80c8c3e` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:35.998218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b603dbe0514addadee439ac80c8c3e)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:36.000746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:36.004614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c35f1fd7614b5598881c7f1c346cc0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.005498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c35f1fd7614b5598881c7f1c346cc0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.019132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c35f1fd7614b5598881c7f1c346cc0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.019897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c35f1fd7614b5598881c7f1c346cc0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.029209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-6fdf1f78-3eb4-4dbb-af36-1c97ffe8bc70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c35f1fd7614b5598881c7f1c346cc0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.056145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1088/2175] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:35 2022] DELETE /identity/v3/users/a8c35f1fd7614b5598881c7f1c346cc0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:36.060661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f348-cde4-4497-b034-745c222ec651 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:36.060959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f348-cde4-4497-b034-745c222ec651 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:36.061240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f348-cde4-4497-b034-745c222ec651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:36.090414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8fa2f348-cde4-4497-b034-745c222ec651 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:36.091671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8fa2f348-cde4-4497-b034-745c222ec651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:36.092916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b603dbe0514addadee439ac80c8c3e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.109247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b603dbe0514addadee439ac80c8c3e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.110116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b603dbe0514addadee439ac80c8c3e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.110813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b603dbe0514addadee439ac80c8c3e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.125456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-daa8f081-6e66-4ff6-b734-6c3224fe82c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b603dbe0514addadee439ac80c8c3e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:36.152651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:36.157865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1088/2176] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:35 2022] DELETE /identity/v3/users/a7b603dbe0514addadee439ac80c8c3e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:36.164581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe725-31c5-4a82-a590-24c93d1cfe2c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:36.164999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe725-31c5-4a82-a590-24c93d1cfe2c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:36.165396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe725-31c5-4a82-a590-24c93d1cfe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:36.191466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a87fe725-31c5-4a82-a590-24c93d1cfe2c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:36.192723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a87fe725-31c5-4a82-a590-24c93d1cfe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:36.197948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1089/2177] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:36.203792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:36.208668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2f348-cde4-4497-b034-745c222ec651 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:36.210527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8fa2f348-cde4-4497-b034-745c222ec651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:36.304307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2f348-cde4-4497-b034-745c222ec651 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:36.318286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1089/2178] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:36.330519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe725-31c5-4a82-a590-24c93d1cfe2c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:36.372657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:36.373849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:36.374562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:36.374748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:36.393794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:36.394531 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:36.415322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1090/2179] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:36.445025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe725-31c5-4a82-a590-24c93d1cfe2c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:36.449104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:36.461766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:36.461766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:36.461766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:36.465599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:36.465599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:36.485641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1090/2180] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:36.906969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:36.909993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:36.927647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c049bcd-be87-461d-9373-9d108f5f091d service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:36.937152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:36.937989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:36.938581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:36.938581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] PATH_INFO: `/v3/projects/ea853d3d8f2b4ca59b26148b79d523d8` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:36.940089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea853d3d8f2b4ca59b26148b79d523d8)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:36.942264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.022027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:37.022027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:37.026330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea853d3d8f2b4ca59b26148b79d523d8', 'request_id': 'req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.038042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a1f89-24c4-44e9-8b0b-ec958a570e56 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:37.038281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea853d3d8f2b4ca59b26148b79d523d8', 'request_id': 'req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.053574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea853d3d8f2b4ca59b26148b79d523d8', 'request_id': 'req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.071553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] The token cache is being invalidate because project ea853d3d8f2b4ca59b26148b79d523d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:37.071865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.072576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-86eb6f8b-1007-4bc0-9bda-c0144fa832ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.074154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1091/2181] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:36 2022] DELETE /identity/v3/projects/ea853d3d8f2b4ca59b26148b79d523d8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:37.116140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:37.116805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.117834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.118157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] PATH_INFO: `/v3/projects/a1fce34c883b4cdca76b5ad9ee793b54` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.119388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fce34c883b4cdca76b5ad9ee793b54)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:37.121401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.184396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fce34c883b4cdca76b5ad9ee793b54', 'request_id': 'req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.193425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fce34c883b4cdca76b5ad9ee793b54', 'request_id': 'req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.202235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fce34c883b4cdca76b5ad9ee793b54', 'request_id': 'req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.203999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:37.219744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] The token cache is being invalidate because project a1fce34c883b4cdca76b5ad9ee793b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:37.220021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.220923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0d6ae13c-392b-4a88-9f4d-dd1021d62e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:37.222546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1091/2182] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:37 2022] DELETE /identity/v3/projects/a1fce34c883b4cdca76b5ad9ee793b54 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:37.227676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477737d5-efdc-4e90-bb95-c07632b85bfa None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.228065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477737d5-efdc-4e90-bb95-c07632b85bfa None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.228445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477737d5-efdc-4e90-bb95-c07632b85bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.253346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-477737d5-efdc-4e90-bb95-c07632b85bfa None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:37.254734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-477737d5-efdc-4e90-bb95-c07632b85bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:37.277310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:37.329098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1092/2183] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:37.337653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eed1b-ebfc-4930-a00a-3a243aa81c74 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.338106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eed1b-ebfc-4930-a00a-3a243aa81c74 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.338448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eed1b-ebfc-4930-a00a-3a243aa81c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.360683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-301eed1b-ebfc-4930-a00a-3a243aa81c74 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:37.362011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-301eed1b-ebfc-4930-a00a-3a243aa81c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:37.371143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1092/2184] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:37.375582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477737d5-efdc-4e90-bb95-c07632b85bfa None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:37.386078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477737d5-efdc-4e90-bb95-c07632b85bfa None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:37.391509 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:37.392315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.392597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.392964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.393937 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:37.394296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:37.397359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.411668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1093/2185] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:37.416706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eed1b-ebfc-4930-a00a-3a243aa81c74 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:37.426503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eed1b-ebfc-4930-a00a-3a243aa81c74 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:37.433213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56ec1-299a-4db9-a82c-f4208cc94d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:37.433882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56ec1-299a-4db9-a82c-f4208cc94d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.434166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56ec1-299a-4db9-a82c-f4208cc94d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.434446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d56ec1-299a-4db9-a82c-f4208cc94d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.435095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d56ec1-299a-4db9-a82c-f4208cc94d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:37.437020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d56ec1-299a-4db9-a82c-f4208cc94d30 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.465974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1093/2186] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:37 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:37.471131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:37.482975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8904-4e10-4da4-9f3e-7936c93d0664 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:37.545736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ba2fc-5d36-4804-8959-6410f2708332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:37.546347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ba2fc-5d36-4804-8959-6410f2708332 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.546623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ba2fc-5d36-4804-8959-6410f2708332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.546891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ba2fc-5d36-4804-8959-6410f2708332 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.547533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ba2fc-5d36-4804-8959-6410f2708332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:37.549425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ba2fc-5d36-4804-8959-6410f2708332 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.572395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1094/2187] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:37 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:37.576999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56ec1-299a-4db9-a82c-f4208cc94d30 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:37.587901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d56ec1-299a-4db9-a82c-f4208cc94d30 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:37.593522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d37f-0ef8-437b-9b1d-1a2f0b81fc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:37.594193 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d37f-0ef8-437b-9b1d-1a2f0b81fc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.594855 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d37f-0ef8-437b-9b1d-1a2f0b81fc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.595202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777d37f-0ef8-437b-9b1d-1a2f0b81fc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.595903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d37f-0ef8-437b-9b1d-1a2f0b81fc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:37.597586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777d37f-0ef8-437b-9b1d-1a2f0b81fc32 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.609973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1094/2188] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:37.614941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ba2fc-5d36-4804-8959-6410f2708332 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:37.626089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ba2fc-5d36-4804-8959-6410f2708332 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:37.630929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fe94a-e4c0-4d44-adb1-178c31b89df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:37.631930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fe94a-e4c0-4d44-adb1-178c31b89df7 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.631930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fe94a-e4c0-4d44-adb1-178c31b89df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.632134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fe94a-e4c0-4d44-adb1-178c31b89df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.632740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fe94a-e4c0-4d44-adb1-178c31b89df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:37.634398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fe94a-e4c0-4d44-adb1-178c31b89df7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.647569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1095/2189] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:37.652261 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d37f-0ef8-437b-9b1d-1a2f0b81fc32 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:37.665436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777d37f-0ef8-437b-9b1d-1a2f0b81fc32 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:37.670865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:37.671544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.671829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.672106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] PATH_INFO: `/v3/projects/771d02fd70d64d819fe9e60433a223eb/users/e3f2391fbe884338b48a9834d5ea54c5/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.687557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] RBAC: Authorizing `identity:create_grant(project_id=771d02fd70d64d819fe9e60433a223eb, user_id=e3f2391fbe884338b48a9834d5ea54c5, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:37.690385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.704764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1095/2190] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:37 2022] PUT /identity/v3/projects/771d02fd70d64d819fe9e60433a223eb/users/e3f2391fbe884338b48a9834d5ea54c5/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:37.716793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131f97-f985-4d64-8f5c-8887ae39973d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.717078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131f97-f985-4d64-8f5c-8887ae39973d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.717349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57131f97-f985-4d64-8f5c-8887ae39973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.747154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-57131f97-f985-4d64-8f5c-8887ae39973d None None] MFA Rules not processed for user `e3f2391fbe884338b48a9834d5ea54c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:37.748622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-57131f97-f985-4d64-8f5c-8887ae39973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:37.843053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1096/2191] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:37.855926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:37.856887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:37.927810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b07d3-7bb5-463b-a022-d4a04d6d069b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:37.934405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe290f3-e5a7-4325-bda8-272a3126b20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:37.935082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe290f3-e5a7-4325-bda8-272a3126b20f service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:37.935341 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe290f3-e5a7-4325-bda8-272a3126b20f service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:37.935594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe290f3-e5a7-4325-bda8-272a3126b20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:37.945058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe290f3-e5a7-4325-bda8-272a3126b20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:37.946600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe290f3-e5a7-4325-bda8-272a3126b20f service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:37.956125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1096/2192] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:39.512110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015af6d-efad-4470-b669-f0c4f556254d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:39.512853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015af6d-efad-4470-b669-f0c4f556254d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:39.513118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015af6d-efad-4470-b669-f0c4f556254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:39.536156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1015af6d-efad-4470-b669-f0c4f556254d None None] MFA Rules not processed for user `e3f2391fbe884338b48a9834d5ea54c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:39.537574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1015af6d-efad-4470-b669-f0c4f556254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:39.549569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1097/2193] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:41.000197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856caec7-5ac7-49dc-abab-999e83aa7540 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:41.000746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856caec7-5ac7-49dc-abab-999e83aa7540 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:41.001158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856caec7-5ac7-49dc-abab-999e83aa7540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:41.042310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-856caec7-5ac7-49dc-abab-999e83aa7540 None None] MFA Rules not processed for user `f7bfaa57173c4ef085e517805d8e5e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:41.045561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-856caec7-5ac7-49dc-abab-999e83aa7540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:41.126539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1097/2194] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:43.076699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dac5e-cf2a-4d4f-b6b2-9672fc624d30 None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:43.077176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dac5e-cf2a-4d4f-b6b2-9672fc624d30 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:43.077376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dac5e-cf2a-4d4f-b6b2-9672fc624d30 None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:43.079973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1098/2195] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:40:43.092696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b5128-b452-4a64-bc8a-f12e68f2e648 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:43.093612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b5128-b452-4a64-bc8a-f12e68f2e648 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:43.093885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b5128-b452-4a64-bc8a-f12e68f2e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:43.126695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e39b5128-b452-4a64-bc8a-f12e68f2e648 None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:43.128672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e39b5128-b452-4a64-bc8a-f12e68f2e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:43.183107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:43.238075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dac5e-cf2a-4d4f-b6b2-9672fc624d30 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:43.242455 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8b9dac5e-cf2a-4d4f-b6b2-9672fc624d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:43.255485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1098/2196] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:43.277324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f39f0-d66e-4c75-99c3-82865dbf5c1d None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:43.277647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f39f0-d66e-4c75-99c3-82865dbf5c1d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:43.278252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:43.278411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f39f0-d66e-4c75-99c3-82865dbf5c1d None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:43.281124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1099/2197] 10.222.0.17 () {54 vars in 961 bytes} [Mon Oct 3 12:40:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:40:43.287162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e69d-de8c-467e-8415-4abf7f6d3e04 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:43.287452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e69d-de8c-467e-8415-4abf7f6d3e04 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:43.287891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e69d-de8c-467e-8415-4abf7f6d3e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:43.315600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-97e4e69d-de8c-467e-8415-4abf7f6d3e04 None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:43.317449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-97e4e69d-de8c-467e-8415-4abf7f6d3e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:43.341345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1100/2198] 10.222.0.17 () {58 vars in 1058 bytes} [Mon Oct 3 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:43.342590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4e69d-de8c-467e-8415-4abf7f6d3e04 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:43.355350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4e69d-de8c-467e-8415-4abf7f6d3e04 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:43.372711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840d52-fafe-43a6-99c0-fa97010f41d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:43.373353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840d52-fafe-43a6-99c0-fa97010f41d3 service placement] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:43.373678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840d52-fafe-43a6-99c0-fa97010f41d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:43.373938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a840d52-fafe-43a6-99c0-fa97010f41d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:43.399257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a840d52-fafe-43a6-99c0-fa97010f41d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:43.406604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a840d52-fafe-43a6-99c0-fa97010f41d3 service placement] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:43.432229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1101/2199] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:43.445390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dac5e-cf2a-4d4f-b6b2-9672fc624d30 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:43.461724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:43.462929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:43.463736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:43.464171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] PATH_INFO: `/v3/users/885ef3fa3d4d4f80be21660f52809565` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:43.467111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885ef3fa3d4d4f80be21660f52809565)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:43.470011 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:43.541593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885ef3fa3d4d4f80be21660f52809565'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.542361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885ef3fa3d4d4f80be21660f52809565'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.551214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885ef3fa3d4d4f80be21660f52809565'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.553072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885ef3fa3d4d4f80be21660f52809565'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.567246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-366d10ce-2fa7-4d51-9c2c-c6bbc38411e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885ef3fa3d4d4f80be21660f52809565'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.595547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1099/2200] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:43 2022] DELETE /identity/v3/users/885ef3fa3d4d4f80be21660f52809565 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:43.811089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840d52-fafe-43a6-99c0-fa97010f41d3 service placement] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:43.824354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a840d52-fafe-43a6-99c0-fa97010f41d3 service placement] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:43.893304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:43.894037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:43.894326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:43.894604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] PATH_INFO: `/v3/projects/8755b2039e084a809de0fa8804d8a1aa` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:43.895861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8755b2039e084a809de0fa8804d8a1aa)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:43.897854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:43.961677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8755b2039e084a809de0fa8804d8a1aa', 'request_id': 'req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.974001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8755b2039e084a809de0fa8804d8a1aa', 'request_id': 'req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.982915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8755b2039e084a809de0fa8804d8a1aa', 'request_id': 'req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.996806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] The token cache is being invalidate because project 8755b2039e084a809de0fa8804d8a1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:43.997101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.997808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0ea0f969-a1eb-4fd1-b332-1bb027f457b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:43.999713 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1102/2201] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:43 2022] DELETE /identity/v3/projects/8755b2039e084a809de0fa8804d8a1aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:44.010732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9856ec-c2df-4ef0-b0d7-c1fbe1965b58 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.010732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9856ec-c2df-4ef0-b0d7-c1fbe1965b58 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.011876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9856ec-c2df-4ef0-b0d7-c1fbe1965b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.033380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8b9856ec-c2df-4ef0-b0d7-c1fbe1965b58 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:44.034651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8b9856ec-c2df-4ef0-b0d7-c1fbe1965b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:44.132172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1100/2202] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:44.141936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28db2-cea1-468a-ad89-257326ca8ad0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.142404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28db2-cea1-468a-ad89-257326ca8ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.142678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28db2-cea1-468a-ad89-257326ca8ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.170314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-43d28db2-cea1-468a-ad89-257326ca8ad0 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:44.171617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-43d28db2-cea1-468a-ad89-257326ca8ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:44.180390 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1103/2203] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:44.184470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9856ec-c2df-4ef0-b0d7-c1fbe1965b58 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:44.219000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9856ec-c2df-4ef0-b0d7-c1fbe1965b58 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:44.230709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:44.231939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.232227 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.232662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.233338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:44.233679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:44.241192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:44.267867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1101/2204] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:44.272562 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28db2-cea1-468a-ad89-257326ca8ad0 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:44.288744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28db2-cea1-468a-ad89-257326ca8ad0 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:44.298714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1717c-b3d0-4784-aa12-3846c326a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:44.299360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1717c-b3d0-4784-aa12-3846c326a6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.299665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1717c-b3d0-4784-aa12-3846c326a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.299933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1717c-b3d0-4784-aa12-3846c326a6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.300599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1717c-b3d0-4784-aa12-3846c326a6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:44.302599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1717c-b3d0-4784-aa12-3846c326a6f7 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:44.360805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1104/2205] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:44 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:44.361584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:44.376189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c1a4b-5053-45e6-a045-810fe1d3534e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:44.436402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:44.517464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285e04-4060-41e1-81ce-4f623a2466f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:44.518130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285e04-4060-41e1-81ce-4f623a2466f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.518414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285e04-4060-41e1-81ce-4f623a2466f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.518724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285e04-4060-41e1-81ce-4f623a2466f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.519370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e285e04-4060-41e1-81ce-4f623a2466f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:44.521561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e285e04-4060-41e1-81ce-4f623a2466f8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:44.563557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1717c-b3d0-4784-aa12-3846c326a6f7 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:44.564282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1102/2206] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:44 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:44.577357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1717c-b3d0-4784-aa12-3846c326a6f7 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:44.583011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bce16-0e13-4bd9-a25d-f8f14eb1fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:44.583637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bce16-0e13-4bd9-a25d-f8f14eb1fa96 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.583915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bce16-0e13-4bd9-a25d-f8f14eb1fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.584189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bce16-0e13-4bd9-a25d-f8f14eb1fa96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.585093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bce16-0e13-4bd9-a25d-f8f14eb1fa96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:44.586801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bce16-0e13-4bd9-a25d-f8f14eb1fa96 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:44.594425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:44.610439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1105/2207] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:44.612110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285e04-4060-41e1-81ce-4f623a2466f8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:44.624224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e285e04-4060-41e1-81ce-4f623a2466f8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:44.630394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde64b6-608d-4da3-9e9b-f537b6c5539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:44.630792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde64b6-608d-4da3-9e9b-f537b6c5539f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.631081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde64b6-608d-4da3-9e9b-f537b6c5539f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.631376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde64b6-608d-4da3-9e9b-f537b6c5539f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.632004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde64b6-608d-4da3-9e9b-f537b6c5539f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:44.634490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde64b6-608d-4da3-9e9b-f537b6c5539f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:44.650204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1103/2208] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:44.651365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bce16-0e13-4bd9-a25d-f8f14eb1fa96 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:44.663203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bce16-0e13-4bd9-a25d-f8f14eb1fa96 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:44.670294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317bb9-28ea-466d-a9b2-9c1e1432e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:44.671187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317bb9-28ea-466d-a9b2-9c1e1432e89b admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.671493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317bb9-28ea-466d-a9b2-9c1e1432e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.671827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317bb9-28ea-466d-a9b2-9c1e1432e89b admin admin] PATH_INFO: `/v3/projects/2f83906de09445e1b6e0c3462d501532/users/98725a29daf34dda9509cb71a602850b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.688923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0317bb9-28ea-466d-a9b2-9c1e1432e89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f83906de09445e1b6e0c3462d501532, user_id=98725a29daf34dda9509cb71a602850b, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:44.691881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0317bb9-28ea-466d-a9b2-9c1e1432e89b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:44.713608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1106/2209] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:44 2022] PUT /identity/v3/projects/2f83906de09445e1b6e0c3462d501532/users/98725a29daf34dda9509cb71a602850b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:44.724545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066209-44b8-4bdc-9921-9e54f483fedf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.724864 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066209-44b8-4bdc-9921-9e54f483fedf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.725212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066209-44b8-4bdc-9921-9e54f483fedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.765849 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-37066209-44b8-4bdc-9921-9e54f483fedf None None] MFA Rules not processed for user `98725a29daf34dda9509cb71a602850b`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:44.767048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-37066209-44b8-4bdc-9921-9e54f483fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:44.856484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1104/2210] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:44.861166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317bb9-28ea-466d-a9b2-9c1e1432e89b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:44.955041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317bb9-28ea-466d-a9b2-9c1e1432e89b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:44.960198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1e072-2245-4982-b443-3771c4d4b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:44.960862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1e072-2245-4982-b443-3771c4d4b99f admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:44.961143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1e072-2245-4982-b443-3771c4d4b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:44.961415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1e072-2245-4982-b443-3771c4d4b99f admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:44.962092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1e072-2245-4982-b443-3771c4d4b99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:44.964022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1e072-2245-4982-b443-3771c4d4b99f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:45.002428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1107/2211] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:44 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:45.002759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066209-44b8-4bdc-9921-9e54f483fedf None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:45.017162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066209-44b8-4bdc-9921-9e54f483fedf None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:45.128727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cc3eb-0fc9-4857-b293-6b002a577ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:45.129366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc3eb-0fc9-4857-b293-6b002a577ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:45.131815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc3eb-0fc9-4857-b293-6b002a577ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:45.132129 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cc3eb-0fc9-4857-b293-6b002a577ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:45.133019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cc3eb-0fc9-4857-b293-6b002a577ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:45.137311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cc3eb-0fc9-4857-b293-6b002a577ff4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:45.166543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1105/2212] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:45 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:45.171022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1e072-2245-4982-b443-3771c4d4b99f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:45.183151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1e072-2245-4982-b443-3771c4d4b99f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:45.188766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941deb56-0b8a-4195-9709-49374f0fd7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:45.189504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deb56-0b8a-4195-9709-49374f0fd7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:45.189892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deb56-0b8a-4195-9709-49374f0fd7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:45.190235 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941deb56-0b8a-4195-9709-49374f0fd7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:45.190961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941deb56-0b8a-4195-9709-49374f0fd7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:45.192676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941deb56-0b8a-4195-9709-49374f0fd7a8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:45.206476 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1108/2213] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:45.211384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cc3eb-0fc9-4857-b293-6b002a577ff4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:45.224369 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cc3eb-0fc9-4857-b293-6b002a577ff4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:45.232853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30354935-3394-46fd-9cb2-7403e5f86ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:45.232853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30354935-3394-46fd-9cb2-7403e5f86ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:45.232853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30354935-3394-46fd-9cb2-7403e5f86ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:45.233226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30354935-3394-46fd-9cb2-7403e5f86ed6 admin admin] PATH_INFO: `/v3/projects/5a8482e55de945d7a080b6d19c27817c/users/cc24ccd4a99549a8bac908d7bbc26346/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:45.252475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:45.257082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30354935-3394-46fd-9cb2-7403e5f86ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8482e55de945d7a080b6d19c27817c, user_id=cc24ccd4a99549a8bac908d7bbc26346, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:45.260510 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30354935-3394-46fd-9cb2-7403e5f86ed6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:45.294816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1106/2214] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:45 2022] PUT /identity/v3/projects/5a8482e55de945d7a080b6d19c27817c/users/cc24ccd4a99549a8bac908d7bbc26346/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:45.299863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941deb56-0b8a-4195-9709-49374f0fd7a8 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:45.322667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941deb56-0b8a-4195-9709-49374f0fd7a8 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:45.390685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42666071-81e6-4e28-928c-a0ad9c3f15d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:45.391305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42666071-81e6-4e28-928c-a0ad9c3f15d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:45.391585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42666071-81e6-4e28-928c-a0ad9c3f15d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:45.391865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42666071-81e6-4e28-928c-a0ad9c3f15d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:45.392514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42666071-81e6-4e28-928c-a0ad9c3f15d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:45.394171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42666071-81e6-4e28-928c-a0ad9c3f15d2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:45.412685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1109/2215] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:40:45.417054 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30354935-3394-46fd-9cb2-7403e5f86ed6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:45.431880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30354935-3394-46fd-9cb2-7403e5f86ed6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:45.437268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:45.437996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:45.438283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:45.438562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] PATH_INFO: `/v3/projects/5a8482e55de945d7a080b6d19c27817c/users/cc24ccd4a99549a8bac908d7bbc26346/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:45.441679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a8482e55de945d7a080b6d19c27817c, user_id=cc24ccd4a99549a8bac908d7bbc26346, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:45.444824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:45.474573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1107/2216] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:45 2022] PUT /identity/v3/projects/5a8482e55de945d7a080b6d19c27817c/users/cc24ccd4a99549a8bac908d7bbc26346/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:45.479101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561ea2-ff7d-4678-a68b-587e506d5e2e None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:45.479654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561ea2-ff7d-4678-a68b-587e506d5e2e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:45.479654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0561ea2-ff7d-4678-a68b-587e506d5e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:45.529644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-d0561ea2-ff7d-4678-a68b-587e506d5e2e None None] MFA Rules not processed for user `cc24ccd4a99549a8bac908d7bbc26346`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:45.530955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d0561ea2-ff7d-4678-a68b-587e506d5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:45.575782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:45.623436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1110/2217] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:45.637167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:45.639778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:45.738783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f78d4-5f91-4b07-8342-93f13ae189c1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:45.744418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:45.745448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:45.746549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:45.746896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:45.759996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:45.761726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:45.774925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1108/2218] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:45.886156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561ea2-ff7d-4678-a68b-587e506d5e2e None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:45.896976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0561ea2-ff7d-4678-a68b-587e506d5e2e None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:45.901481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074cc9e-263a-44ba-a49a-39e0f2802b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:45.902004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074cc9e-263a-44ba-a49a-39e0f2802b63 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:45.902269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074cc9e-263a-44ba-a49a-39e0f2802b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:45.903329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074cc9e-263a-44ba-a49a-39e0f2802b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:45.980044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074cc9e-263a-44ba-a49a-39e0f2802b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:45.981967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074cc9e-263a-44ba-a49a-39e0f2802b63 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:45.993672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1111/2219] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:40:55.768686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=34,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:55.988284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=41 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:56.240543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:56.243733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:56.333100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b93d-3a05-40d6-9b61-343c6fc561f1 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:56.341676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:56.342629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:56.342939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:56.343438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] PATH_INFO: `/v3/users/b1b8ef6601cd48af803cb18b3b386fce` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:56.345408 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b8ef6601cd48af803cb18b3b386fce)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:56.349490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:56.417652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b8ef6601cd48af803cb18b3b386fce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:56.418327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b8ef6601cd48af803cb18b3b386fce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:56.433720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b8ef6601cd48af803cb18b3b386fce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:56.434491 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b8ef6601cd48af803cb18b3b386fce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:56.442809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b8ef6601cd48af803cb18b3b386fce'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:56.462773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1109/2220] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:40:56 2022] DELETE /identity/v3/users/b1b8ef6601cd48af803cb18b3b386fce => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:40:56.467406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075826d-7640-4a57-bc47-f27ccdabb031 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:56.467692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075826d-7640-4a57-bc47-f27ccdabb031 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:56.467952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075826d-7640-4a57-bc47-f27ccdabb031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:56.490095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f075826d-7640-4a57-bc47-f27ccdabb031 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:56.491657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f075826d-7640-4a57-bc47-f27ccdabb031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:56.585204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1112/2221] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:56.593417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:56.595050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:56.675640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31628f3-0a72-429d-8d84-d4f7428333a5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:56.682245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0e3d7-5133-4bab-a6eb-e7bb337108be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:56.683308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0e3d7-5133-4bab-a6eb-e7bb337108be service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:56.683821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0e3d7-5133-4bab-a6eb-e7bb337108be service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:56.684324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0e3d7-5133-4bab-a6eb-e7bb337108be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:56.706031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0e3d7-5133-4bab-a6eb-e7bb337108be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:56.708441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0e3d7-5133-4bab-a6eb-e7bb337108be service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:56.719310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1110/2222] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:40:57.071055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075826d-7640-4a57-bc47-f27ccdabb031 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:57.073085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f075826d-7640-4a57-bc47-f27ccdabb031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:57.100618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075826d-7640-4a57-bc47-f27ccdabb031 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:57.110147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:57.111325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:57.112393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:57.112393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] PATH_INFO: `/v3/projects/a5d860929bb3431097d97d22ebd867ef` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:57.114478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d860929bb3431097d97d22ebd867ef)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:57.119325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:57.213553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d860929bb3431097d97d22ebd867ef', 'request_id': 'req-4fee52da-8c9a-41e1-b8ff-9106edd698a0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:57.225394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d860929bb3431097d97d22ebd867ef', 'request_id': 'req-4fee52da-8c9a-41e1-b8ff-9106edd698a0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:57.249043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d860929bb3431097d97d22ebd867ef', 'request_id': 'req-4fee52da-8c9a-41e1-b8ff-9106edd698a0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:57.280165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] The token cache is being invalidate because project a5d860929bb3431097d97d22ebd867ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:40:57.280165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:57.280685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fee52da-8c9a-41e1-b8ff-9106edd698a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:40:57.287256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1113/2223] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:40:57 2022] DELETE /identity/v3/projects/a5d860929bb3431097d97d22ebd867ef => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:57.290419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a447-6785-4fe1-8372-c0a3571339d0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:57.291126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a447-6785-4fe1-8372-c0a3571339d0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:57.291512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223a447-6785-4fe1-8372-c0a3571339d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:57.354143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d223a447-6785-4fe1-8372-c0a3571339d0 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:57.354143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d223a447-6785-4fe1-8372-c0a3571339d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:57.385422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:57.512135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e7ade-a120-443f-80a6-f45acdce3d28 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:57.512492 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e7ade-a120-443f-80a6-f45acdce3d28 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:57.512833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e7ade-a120-443f-80a6-f45acdce3d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:57.513866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1111/2224] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:57.537106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2b4e7ade-a120-443f-80a6-f45acdce3d28 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:57.538644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2b4e7ade-a120-443f-80a6-f45acdce3d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:57.549539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1114/2225] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:40:57.555345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223a447-6785-4fe1-8372-c0a3571339d0 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:57.570374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223a447-6785-4fe1-8372-c0a3571339d0 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:57.576989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:57.577725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:57.578037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:57.578473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:57.579777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:40:57.580101 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:57.582643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:57.602674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1112/2226] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:40:57.608016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e7ade-a120-443f-80a6-f45acdce3d28 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:57.626478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e7ade-a120-443f-80a6-f45acdce3d28 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:57.636912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e72dd7-8f99-49d4-98b4-bbf61ccc31ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:57.637660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72dd7-8f99-49d4-98b4-bbf61ccc31ce admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:57.637969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72dd7-8f99-49d4-98b4-bbf61ccc31ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:57.638436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72dd7-8f99-49d4-98b4-bbf61ccc31ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:57.639111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e72dd7-8f99-49d4-98b4-bbf61ccc31ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:57.641703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e72dd7-8f99-49d4-98b4-bbf61ccc31ce admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:57.726267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1115/2227] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:40:57.730879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:57.746186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c84a6e-2e82-4c72-8efc-23107a88e210 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:57.869281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29607d8-32be-4348-9c32-d3bd6aa452e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:57.870401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29607d8-32be-4348-9c32-d3bd6aa452e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:57.870895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29607d8-32be-4348-9c32-d3bd6aa452e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:57.871389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29607d8-32be-4348-9c32-d3bd6aa452e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:57.872269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29607d8-32be-4348-9c32-d3bd6aa452e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:57.874778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29607d8-32be-4348-9c32-d3bd6aa452e2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:57.911366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1113/2228] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:40:57 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:40:57.917825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e72dd7-8f99-49d4-98b4-bbf61ccc31ce admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:57.938695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e72dd7-8f99-49d4-98b4-bbf61ccc31ce admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:57.950129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884bff-1403-48ab-93a1-5cd7d94e8857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:57.951395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884bff-1403-48ab-93a1-5cd7d94e8857 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:57.952017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884bff-1403-48ab-93a1-5cd7d94e8857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:57.952676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884bff-1403-48ab-93a1-5cd7d94e8857 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:57.953843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da884bff-1403-48ab-93a1-5cd7d94e8857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:57.956806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da884bff-1403-48ab-93a1-5cd7d94e8857 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:57.981575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1116/2229] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:57.986023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29607d8-32be-4348-9c32-d3bd6aa452e2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:57.997971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29607d8-32be-4348-9c32-d3bd6aa452e2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:58.003504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab20ba-75eb-426a-bc1b-b4a789542c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:58.004342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab20ba-75eb-426a-bc1b-b4a789542c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:58.004806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab20ba-75eb-426a-bc1b-b4a789542c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:58.005188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab20ba-75eb-426a-bc1b-b4a789542c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:58.006007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab20ba-75eb-426a-bc1b-b4a789542c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:58.008417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab20ba-75eb-426a-bc1b-b4a789542c56 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:58.021423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1114/2230] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:40:58.026999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884bff-1403-48ab-93a1-5cd7d94e8857 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:58.038557 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884bff-1403-48ab-93a1-5cd7d94e8857 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:58.043612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:58.044306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:58.044662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:58.044946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] PATH_INFO: `/v3/projects/0fa56b47bf8c466081241edf6b3f7234/users/9ef6fd6a154b42d98419f1fb18be1e35/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:58.064673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa56b47bf8c466081241edf6b3f7234, user_id=9ef6fd6a154b42d98419f1fb18be1e35, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:58.067612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:58.087779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1117/2231] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:40:58 2022] PUT /identity/v3/projects/0fa56b47bf8c466081241edf6b3f7234/users/9ef6fd6a154b42d98419f1fb18be1e35/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:40:58.104691 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44379a9-aaa5-41c5-af8c-c667e67861fe None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:58.105009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44379a9-aaa5-41c5-af8c-c667e67861fe None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:58.105289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44379a9-aaa5-41c5-af8c-c667e67861fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:58.146410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d44379a9-aaa5-41c5-af8c-c667e67861fe None None] MFA Rules not processed for user `9ef6fd6a154b42d98419f1fb18be1e35`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:40:58.149286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d44379a9-aaa5-41c5-af8c-c667e67861fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:58.249794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1115/2232] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:40:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:40:58.261202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:40:58.263465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:40:58.290032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:40:58.334138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f471a17-afbc-496e-9a2c-14b418085ccc admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:40:58.339250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:40:58.339877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:40:58.340162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:40:58.340448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:40:58.350177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:40:58.351701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:40:58.363996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1118/2233] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:40:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:08.244788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:08.357380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=17 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:09.922224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8f093-707a-456b-94ec-d42141ecabf3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:09.922855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8f093-707a-456b-94ec-d42141ecabf3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:09.923187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8f093-707a-456b-94ec-d42141ecabf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:09.955496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-97a8f093-707a-456b-94ec-d42141ecabf3 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:09.958306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-97a8f093-707a-456b-94ec-d42141ecabf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:10.067532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1116/2234] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:41:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:10.191616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:10.193715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:10.208589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8f093-707a-456b-94ec-d42141ecabf3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:10.333408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31c37b-bf73-4d44-a4e3-587e4a8bb287 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:10.344773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1a6fa-52f6-40e2-8c3d-45b4cbbd6a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:10.345935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1a6fa-52f6-40e2-8c3d-45b4cbbd6a72 service swift] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:10.346409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1a6fa-52f6-40e2-8c3d-45b4cbbd6a72 service swift] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:10.346943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1a6fa-52f6-40e2-8c3d-45b4cbbd6a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:10.352584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8f093-707a-456b-94ec-d42141ecabf3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:10.360837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:10.362027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:10.362469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:10.362626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1a6fa-52f6-40e2-8c3d-45b4cbbd6a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:10.362938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] PATH_INFO: `/v3/users/9ef6fd6a154b42d98419f1fb18be1e35` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:10.365106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef6fd6a154b42d98419f1fb18be1e35)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:10.365698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1a6fa-52f6-40e2-8c3d-45b4cbbd6a72 service swift] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:10.368714 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:10.381037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1119/2235] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:41:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:41:10.438351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef6fd6a154b42d98419f1fb18be1e35'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:10.439381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef6fd6a154b42d98419f1fb18be1e35'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:10.448898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef6fd6a154b42d98419f1fb18be1e35'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:10.450066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef6fd6a154b42d98419f1fb18be1e35'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:10.462766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef6fd6a154b42d98419f1fb18be1e35'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:10.488035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1117/2236] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:10 2022] DELETE /identity/v3/users/9ef6fd6a154b42d98419f1fb18be1e35 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:10.492982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d1ac-65b0-4c8d-9f68-cec1ba4a5ad3 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:10.493390 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d1ac-65b0-4c8d-9f68-cec1ba4a5ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:10.493800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a99d1ac-65b0-4c8d-9f68-cec1ba4a5ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:10.516490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5a99d1ac-65b0-4c8d-9f68-cec1ba4a5ad3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:10.518030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5a99d1ac-65b0-4c8d-9f68-cec1ba4a5ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:10.605581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1120/2237] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:10.617782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:10.620150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:10.658846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:10.728080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b65d3-df7d-4b64-b7fc-01a9bb4ea743 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:10.732551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adacfd-1440-4f0f-9901-9c674dc12318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:10.733439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adacfd-1440-4f0f-9901-9c674dc12318 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:10.734108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adacfd-1440-4f0f-9901-9c674dc12318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:10.734807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adacfd-1440-4f0f-9901-9c674dc12318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:10.746759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adacfd-1440-4f0f-9901-9c674dc12318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:10.748241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adacfd-1440-4f0f-9901-9c674dc12318 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:10.763257 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1118/2238] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:11.133116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99d1ac-65b0-4c8d-9f68-cec1ba4a5ad3 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:11.135204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5a99d1ac-65b0-4c8d-9f68-cec1ba4a5ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:11.177710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a99d1ac-65b0-4c8d-9f68-cec1ba4a5ad3 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:11.185231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:11.185960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:11.186360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:11.186511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] PATH_INFO: `/v3/projects/0fa56b47bf8c466081241edf6b3f7234` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:11.187915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa56b47bf8c466081241edf6b3f7234)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:11.189839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:11.233062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abc36a-2ecd-4fc6-b6f4-5ad55feaabd2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:11.233806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abc36a-2ecd-4fc6-b6f4-5ad55feaabd2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:11.233991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abc36a-2ecd-4fc6-b6f4-5ad55feaabd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:11.264192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa56b47bf8c466081241edf6b3f7234', 'request_id': 'req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:11.266867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-50abc36a-2ecd-4fc6-b6f4-5ad55feaabd2 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:11.268857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-50abc36a-2ecd-4fc6-b6f4-5ad55feaabd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:11.278829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa56b47bf8c466081241edf6b3f7234', 'request_id': 'req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:11.287403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa56b47bf8c466081241edf6b3f7234', 'request_id': 'req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:11.302179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] The token cache is being invalidate because project 0fa56b47bf8c466081241edf6b3f7234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:11.302573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:11.303426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-bdda27c6-79bf-4f3d-a613-7bb9cf739a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:11.305180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1121/2239] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:11 2022] DELETE /identity/v3/projects/0fa56b47bf8c466081241edf6b3f7234 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:11.310785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f1dec-c44b-4f31-8c77-187bdd0db181 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:11.311070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f1dec-c44b-4f31-8c77-187bdd0db181 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:11.311352 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f1dec-c44b-4f31-8c77-187bdd0db181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:11.340028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a49f1dec-c44b-4f31-8c77-187bdd0db181 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:11.342561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a49f1dec-c44b-4f31-8c77-187bdd0db181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:11.357702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1119/2240] 10.222.0.17 () {58 vars in 967 bytes} [Mon Oct 3 12:41:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:11.368470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:11.389470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abc36a-2ecd-4fc6-b6f4-5ad55feaabd2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:11.395916 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-50abc36a-2ecd-4fc6-b6f4-5ad55feaabd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:11.464578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1122/2241] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:11.473387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae3b0-5bef-4872-99cf-74ed2e6dde05 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:11.476888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae3b0-5bef-4872-99cf-74ed2e6dde05 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:11.477430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae3b0-5bef-4872-99cf-74ed2e6dde05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:11.506393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-d66ae3b0-5bef-4872-99cf-74ed2e6dde05 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:11.508283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d66ae3b0-5bef-4872-99cf-74ed2e6dde05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:11.512604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abc36a-2ecd-4fc6-b6f4-5ad55feaabd2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:11.524389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673edd3-0f82-4c34-9c6f-0b4afc52ccd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:11.525071 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673edd3-0f82-4c34-9c6f-0b4afc52ccd4 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:11.525351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673edd3-0f82-4c34-9c6f-0b4afc52ccd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:11.525674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673edd3-0f82-4c34-9c6f-0b4afc52ccd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:11.528865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1123/2242] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:11.533416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae3b0-5bef-4872-99cf-74ed2e6dde05 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:11.542927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673edd3-0f82-4c34-9c6f-0b4afc52ccd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:11.545027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae3b0-5bef-4872-99cf-74ed2e6dde05 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:11.549553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673edd3-0f82-4c34-9c6f-0b4afc52ccd4 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:11.564414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:11.566151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:11.566437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:11.566711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:11.567398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:41:11.567705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:11.570150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:11.606222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1120/2243] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:41:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:41:11.625363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1124/2244] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:41:11.627609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673edd3-0f82-4c34-9c6f-0b4afc52ccd4 service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:11.667815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673edd3-0f82-4c34-9c6f-0b4afc52ccd4 service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:11.676181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd36f4-fb03-4ef2-a4b0-eb8d19debdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:11.678153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd36f4-fb03-4ef2-a4b0-eb8d19debdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:11.679468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd36f4-fb03-4ef2-a4b0-eb8d19debdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:11.679917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd36f4-fb03-4ef2-a4b0-eb8d19debdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:11.680767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd36f4-fb03-4ef2-a4b0-eb8d19debdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:11.696658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd36f4-fb03-4ef2-a4b0-eb8d19debdc7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:11.859045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:11.865634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1121/2245] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:11 2022] POST /identity/v3/projects => generated 391 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:41:11.875698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9eb5b-fd92-4d2c-b5ee-e161add28f95 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:12.028152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7f4a7-82c2-4593-8ba5-e5c1101f5af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:12.029338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7f4a7-82c2-4593-8ba5-e5c1101f5af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.030083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7f4a7-82c2-4593-8ba5-e5c1101f5af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.030681 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7f4a7-82c2-4593-8ba5-e5c1101f5af8 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.031952 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7f4a7-82c2-4593-8ba5-e5c1101f5af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:12.036649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7f4a7-82c2-4593-8ba5-e5c1101f5af8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:12.090416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1125/2246] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:11 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:12.096675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd36f4-fb03-4ef2-a4b0-eb8d19debdc7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:12.114229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd36f4-fb03-4ef2-a4b0-eb8d19debdc7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:12.126233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2ce7e-b62c-40d6-b417-a1d396d30198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:12.126921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ce7e-b62c-40d6-b417-a1d396d30198 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.127254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ce7e-b62c-40d6-b417-a1d396d30198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.127604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ce7e-b62c-40d6-b417-a1d396d30198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.128448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2ce7e-b62c-40d6-b417-a1d396d30198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:12.128604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ebc69-21a8-4d92-be48-93917dd6543b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.129039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ebc69-21a8-4d92-be48-93917dd6543b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.129999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ebc69-21a8-4d92-be48-93917dd6543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.130724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2ce7e-b62c-40d6-b417-a1d396d30198 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:12.154390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1122/2247] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:12.160165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2ce7e-b62c-40d6-b417-a1d396d30198 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:12.174926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2ce7e-b62c-40d6-b417-a1d396d30198 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:12.183659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36ade-5d82-4b50-ac7c-a8af6345f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:12.185046 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36ade-5d82-4b50-ac7c-a8af6345f485 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.185480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36ade-5d82-4b50-ac7c-a8af6345f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.185939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c36ade-5d82-4b50-ac7c-a8af6345f485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.186738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c36ade-5d82-4b50-ac7c-a8af6345f485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:12.189682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c36ade-5d82-4b50-ac7c-a8af6345f485 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:12.194663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-685ebc69-21a8-4d92-be48-93917dd6543b None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:12.196536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-685ebc69-21a8-4d92-be48-93917dd6543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:12.204082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1123/2248] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:12.208796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36ade-5d82-4b50-ac7c-a8af6345f485 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:12.221791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c36ade-5d82-4b50-ac7c-a8af6345f485 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:12.228739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa311-f74f-47b3-88a7-de651745ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:12.229586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa311-f74f-47b3-88a7-de651745ac0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.230156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa311-f74f-47b3-88a7-de651745ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.230438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854aa311-f74f-47b3-88a7-de651745ac0e admin admin] PATH_INFO: `/v3/projects/3705597a04084d64924e05397fe21e8a/users/831a19a69e8045fea8177cd0cbea8e47/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.249804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854aa311-f74f-47b3-88a7-de651745ac0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3705597a04084d64924e05397fe21e8a, user_id=831a19a69e8045fea8177cd0cbea8e47, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:12.252824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854aa311-f74f-47b3-88a7-de651745ac0e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:12.255884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:12.268495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1126/2249] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:12.273234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1124/2250] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:12 2022] PUT /identity/v3/projects/3705597a04084d64924e05397fe21e8a/users/831a19a69e8045fea8177cd0cbea8e47/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:41:12.284484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c6592-0873-46d3-935c-266b19cac7ef None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.284776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c6592-0873-46d3-935c-266b19cac7ef None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.285094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c6592-0873-46d3-935c-266b19cac7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.286758 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa311-f74f-47b3-88a7-de651745ac0e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:12.316605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8b1c6592-0873-46d3-935c-266b19cac7ef None None] MFA Rules not processed for user `831a19a69e8045fea8177cd0cbea8e47`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:12.318437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8b1c6592-0873-46d3-935c-266b19cac7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:12.352902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:12.372867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854aa311-f74f-47b3-88a7-de651745ac0e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:12.380243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21731f-e858-4e29-a3bc-0c8949bd30c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:12.380995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21731f-e858-4e29-a3bc-0c8949bd30c4 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.381283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21731f-e858-4e29-a3bc-0c8949bd30c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.381615 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21731f-e858-4e29-a3bc-0c8949bd30c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.416723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1127/2251] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:12.431049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c6592-0873-46d3-935c-266b19cac7ef None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:12.433230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8b1c6592-0873-46d3-935c-266b19cac7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:12.468581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21731f-e858-4e29-a3bc-0c8949bd30c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:12.470451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21731f-e858-4e29-a3bc-0c8949bd30c4 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:12.481012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1125/2252] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:41:12.519477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c6592-0873-46d3-935c-266b19cac7ef None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:12.524625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e786b-3a10-4b5c-b739-d9a51f0f0171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:12.525320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e786b-3a10-4b5c-b739-d9a51f0f0171 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.525789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e786b-3a10-4b5c-b739-d9a51f0f0171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.525957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e786b-3a10-4b5c-b739-d9a51f0f0171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.536112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e786b-3a10-4b5c-b739-d9a51f0f0171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:12.540418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e786b-3a10-4b5c-b739-d9a51f0f0171 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:12.550826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1128/2253] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:12.904396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fdc4-c2fd-4c67-8ef2-e3fa58e3a19b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:12.905139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fdc4-c2fd-4c67-8ef2-e3fa58e3a19b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:12.905647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317fdc4-c2fd-4c67-8ef2-e3fa58e3a19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:12.942109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2317fdc4-c2fd-4c67-8ef2-e3fa58e3a19b None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:12.944104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2317fdc4-c2fd-4c67-8ef2-e3fa58e3a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:12.958083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1126/2254] 10.222.0.17 () {58 vars in 967 bytes} [Mon Oct 3 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:12.978147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e786b-3a10-4b5c-b739-d9a51f0f0171 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:12.997182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e786b-3a10-4b5c-b739-d9a51f0f0171 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:13.024447 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c842436-963b-4894-8ef0-d514ef5026b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:13.025080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842436-963b-4894-8ef0-d514ef5026b7 service swift] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:13.025363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842436-963b-4894-8ef0-d514ef5026b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:13.025694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842436-963b-4894-8ef0-d514ef5026b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:13.035605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c842436-963b-4894-8ef0-d514ef5026b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:13.037306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c842436-963b-4894-8ef0-d514ef5026b7 service swift] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:13.049287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1129/2255] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:41:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 12:41:15.708313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317fdc4-c2fd-4c67-8ef2-e3fa58e3a19b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:15.709983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2317fdc4-c2fd-4c67-8ef2-e3fa58e3a19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:15.790561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317fdc4-c2fd-4c67-8ef2-e3fa58e3a19b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:15.795598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:15.796256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:15.796543 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:15.796823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] PATH_INFO: `/v3/users/e3f2391fbe884338b48a9834d5ea54c5` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:15.798171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f2391fbe884338b48a9834d5ea54c5)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:15.800279 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:15.849620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=1,keystone:SELECT=94,keystone:DELETE=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:15.866835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f2391fbe884338b48a9834d5ea54c5'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:15.867652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f2391fbe884338b48a9834d5ea54c5'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:15.876370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f2391fbe884338b48a9834d5ea54c5'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:15.877331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f2391fbe884338b48a9834d5ea54c5'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:15.887569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f2391fbe884338b48a9834d5ea54c5'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:15.915205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1127/2256] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:15 2022] DELETE /identity/v3/users/e3f2391fbe884338b48a9834d5ea54c5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:15.920561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492471f-37f5-4702-95b8-e1ee6ad13737 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:15.921263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492471f-37f5-4702-95b8-e1ee6ad13737 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:15.921263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492471f-37f5-4702-95b8-e1ee6ad13737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:15.942619 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-9492471f-37f5-4702-95b8-e1ee6ad13737 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:15.943807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9492471f-37f5-4702-95b8-e1ee6ad13737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:16.015087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1130/2257] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:16.026212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:16.027795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:16.105508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53f5fb-95fa-4e74-8d8b-7485906668ec admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:16.110417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48725345-ca9d-419b-b3b3-d7152cf87b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:16.111128 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48725345-ca9d-419b-b3b3-d7152cf87b5c service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:16.111501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48725345-ca9d-419b-b3b3-d7152cf87b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:16.111869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48725345-ca9d-419b-b3b3-d7152cf87b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:16.122768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48725345-ca9d-419b-b3b3-d7152cf87b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:16.124415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48725345-ca9d-419b-b3b3-d7152cf87b5c service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:16.142640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1128/2258] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:16.359687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492471f-37f5-4702-95b8-e1ee6ad13737 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:16.361172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9492471f-37f5-4702-95b8-e1ee6ad13737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:16.373873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492471f-37f5-4702-95b8-e1ee6ad13737 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:16.381160 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:16.381495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:16.381799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:16.382636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] PATH_INFO: `/v3/projects/771d02fd70d64d819fe9e60433a223eb` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:16.383812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771d02fd70d64d819fe9e60433a223eb)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:16.386604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:16.456445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:16.464394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771d02fd70d64d819fe9e60433a223eb', 'request_id': 'req-1e142e89-87b7-4f40-95b7-e15b34870859'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:16.474935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771d02fd70d64d819fe9e60433a223eb', 'request_id': 'req-1e142e89-87b7-4f40-95b7-e15b34870859'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:16.484581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771d02fd70d64d819fe9e60433a223eb', 'request_id': 'req-1e142e89-87b7-4f40-95b7-e15b34870859'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:16.497728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] The token cache is being invalidate because project 771d02fd70d64d819fe9e60433a223eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:16.497957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:16.498648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:16.500190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1131/2259] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:16 2022] DELETE /identity/v3/projects/771d02fd70d64d819fe9e60433a223eb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:41:17.319967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c84c-e9b0-4860-b6f1-b2d5928f8310 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:17.320504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c84c-e9b0-4860-b6f1-b2d5928f8310 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:17.320504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967c84c-e9b0-4860-b6f1-b2d5928f8310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:17.354070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9967c84c-e9b0-4860-b6f1-b2d5928f8310 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:17.356136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9967c84c-e9b0-4860-b6f1-b2d5928f8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:17.423172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1129/2260] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:41:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:17.436657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:17.438264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:17.531679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e142e89-87b7-4f40-95b7-e15b34870859 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:17.540653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d31f49-78b8-4b3d-ac4b-239da229b540 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:17.541575 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31f49-78b8-4b3d-ac4b-239da229b540 service swift] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:17.541857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31f49-78b8-4b3d-ac4b-239da229b540 service swift] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:17.542127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d31f49-78b8-4b3d-ac4b-239da229b540 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:17.556576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d31f49-78b8-4b3d-ac4b-239da229b540 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:17.559741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d31f49-78b8-4b3d-ac4b-239da229b540 service swift] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:17.576831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1132/2261] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:41:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:41:21.188053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967c84c-e9b0-4860-b6f1-b2d5928f8310 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:21.191368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9967c84c-e9b0-4860-b6f1-b2d5928f8310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:21.355470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:21.370059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967c84c-e9b0-4860-b6f1-b2d5928f8310 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:21.377878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:21.378917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:21.379367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:21.379900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] PATH_INFO: `/v3/users/98725a29daf34dda9509cb71a602850b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:21.381389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98725a29daf34dda9509cb71a602850b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:21.384346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:21.478940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98725a29daf34dda9509cb71a602850b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:21.480433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98725a29daf34dda9509cb71a602850b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:21.496357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98725a29daf34dda9509cb71a602850b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:21.498214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98725a29daf34dda9509cb71a602850b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:21.510393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98725a29daf34dda9509cb71a602850b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:21.540017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1130/2262] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:21 2022] DELETE /identity/v3/users/98725a29daf34dda9509cb71a602850b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:21.547609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89d32-1d46-4831-bb3f-59928fc96c3f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:21.549111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89d32-1d46-4831-bb3f-59928fc96c3f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:21.549975 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c89d32-1d46-4831-bb3f-59928fc96c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:21.587001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e7c89d32-1d46-4831-bb3f-59928fc96c3f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:21.589290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e7c89d32-1d46-4831-bb3f-59928fc96c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:21.734051 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1133/2263] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:21.742527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:21.745048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:21.848191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707481af-8978-4e77-8fc7-e081d65dbe3b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:21.854154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:21.854824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:21.855104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:21.855385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:21.865915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:21.867940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:21.879232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1131/2264] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:22.006323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3359664-ec68-40f8-a1d5-bf2d0d98d527 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:22.006826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3359664-ec68-40f8-a1d5-bf2d0d98d527 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:22.007094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3359664-ec68-40f8-a1d5-bf2d0d98d527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:22.029894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a3359664-ec68-40f8-a1d5-bf2d0d98d527 None None] MFA Rules not processed for user `a76145d9b91d477cb13d499eccff90d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:22.031151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a3359664-ec68-40f8-a1d5-bf2d0d98d527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:22.125597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1134/2265] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:22.357268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:22.359389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:22.383934 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb2167-f98f-4898-9004-f790cb3157b3 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:22.416102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:22.416690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:22.417061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:22.417345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] PATH_INFO: `/v3/projects/2f83906de09445e1b6e0c3462d501532` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:22.418641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f83906de09445e1b6e0c3462d501532)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:22.420903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:22.541948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f83906de09445e1b6e0c3462d501532', 'request_id': 'req-d3206bc2-5306-4f83-bedb-5d4acaac232c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.541948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f83906de09445e1b6e0c3462d501532', 'request_id': 'req-d3206bc2-5306-4f83-bedb-5d4acaac232c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.552760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f83906de09445e1b6e0c3462d501532', 'request_id': 'req-d3206bc2-5306-4f83-bedb-5d4acaac232c'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.561936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:22.566897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] The token cache is being invalidate because project 2f83906de09445e1b6e0c3462d501532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:22.567198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.567959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.574098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1132/2266] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:22 2022] DELETE /identity/v3/projects/2f83906de09445e1b6e0c3462d501532 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:22.575277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3359664-ec68-40f8-a1d5-bf2d0d98d527 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:22.595742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3359664-ec68-40f8-a1d5-bf2d0d98d527 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:22.604211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:22.697329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:22.704719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:22.704719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:22.704719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] PATH_INFO: `/v3/users/cc24ccd4a99549a8bac908d7bbc26346` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:22.704719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc24ccd4a99549a8bac908d7bbc26346)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:22.710445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:22.789260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc24ccd4a99549a8bac908d7bbc26346'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.802443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc24ccd4a99549a8bac908d7bbc26346'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.803497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc24ccd4a99549a8bac908d7bbc26346'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.804332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc24ccd4a99549a8bac908d7bbc26346'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.818183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc24ccd4a99549a8bac908d7bbc26346'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:22.863544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1135/2267] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:22 2022] DELETE /identity/v3/users/cc24ccd4a99549a8bac908d7bbc26346 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:23.457977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:23.462335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:23.512039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3206bc2-5306-4f83-bedb-5d4acaac232c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:23.602866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:23.604135 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:23.606302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:23.606302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:23.606302 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] PATH_INFO: `/v3/projects/5a8482e55de945d7a080b6d19c27817c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:23.606567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:23.610058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a8482e55de945d7a080b6d19c27817c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:23.618418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:23.646124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015bd77-79c3-4faf-bad1-f2384fedc14d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:23.654884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:23.655875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:23.656361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:23.657400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] PATH_INFO: `/v3/users/831a19a69e8045fea8177cd0cbea8e47` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:23.659377 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831a19a69e8045fea8177cd0cbea8e47)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:23.662712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:23.738045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a8482e55de945d7a080b6d19c27817c', 'request_id': 'req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.753746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a8482e55de945d7a080b6d19c27817c', 'request_id': 'req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.764841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831a19a69e8045fea8177cd0cbea8e47'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.767977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a8482e55de945d7a080b6d19c27817c', 'request_id': 'req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.782912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831a19a69e8045fea8177cd0cbea8e47'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.783861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831a19a69e8045fea8177cd0cbea8e47'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.784582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831a19a69e8045fea8177cd0cbea8e47'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.797226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] The token cache is being invalidate because project 5a8482e55de945d7a080b6d19c27817c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:23.797226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.797226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0b6e97d1-2b48-4d7f-b5db-e73e842f654f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.799192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1133/2268] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:23 2022] DELETE /identity/v3/projects/5a8482e55de945d7a080b6d19c27817c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:23.799437 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f331f1f6-c766-4cf8-a60b-d9afbd30bcb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831a19a69e8045fea8177cd0cbea8e47'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:23.806630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae8c26-7f54-4f34-a808-9cd8bf6bfeb1 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:23.807753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae8c26-7f54-4f34-a808-9cd8bf6bfeb1 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:23.808010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae8c26-7f54-4f34-a808-9cd8bf6bfeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:23.823306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:23.831847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1136/2269] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:23 2022] DELETE /identity/v3/users/831a19a69e8045fea8177cd0cbea8e47 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:41:23.839776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9fc99-2d38-479d-8a0a-e3d9a7e494c2 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:23.839776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9fc99-2d38-479d-8a0a-e3d9a7e494c2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:23.839776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9fc99-2d38-479d-8a0a-e3d9a7e494c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:23.849153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f4ae8c26-7f54-4f34-a808-9cd8bf6bfeb1 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:23.851821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f4ae8c26-7f54-4f34-a808-9cd8bf6bfeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:23.862893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3bd9fc99-2d38-479d-8a0a-e3d9a7e494c2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:23.864357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3bd9fc99-2d38-479d-8a0a-e3d9a7e494c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:23.953683 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1137/2270] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:23.960930 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9fc99-2d38-479d-8a0a-e3d9a7e494c2 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:23.965005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3bd9fc99-2d38-479d-8a0a-e3d9a7e494c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:23.983829 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1134/2271] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:23.992784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877570-0062-481b-bc19-3c0953350b4c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:23.993441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877570-0062-481b-bc19-3c0953350b4c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:23.993818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877570-0062-481b-bc19-3c0953350b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.023569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-bd877570-0062-481b-bc19-3c0953350b4c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:24.024015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bd877570-0062-481b-bc19-3c0953350b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:24.035600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1135/2272] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:24.041457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877570-0062-481b-bc19-3c0953350b4c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:24.056584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877570-0062-481b-bc19-3c0953350b4c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.062968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.063594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.063879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.064157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.066089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:41:24.068852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.072866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.079320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9fc99-2d38-479d-8a0a-e3d9a7e494c2 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.089026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c50f6e-693a-45aa-afc3-51ce2c7661d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.090523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50f6e-693a-45aa-afc3-51ce2c7661d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.091313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50f6e-693a-45aa-afc3-51ce2c7661d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.092032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50f6e-693a-45aa-afc3-51ce2c7661d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.104001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1136/2273] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:41:24.111095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:24.126258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c50f6e-693a-45aa-afc3-51ce2c7661d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.128948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c50f6e-693a-45aa-afc3-51ce2c7661d8 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.130520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d10d32-b18c-42aa-8245-ff68e439c254 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.146582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7fb5f-eded-4d2a-a434-df3f2083b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.147228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7fb5f-eded-4d2a-a434-df3f2083b759 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.148185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7fb5f-eded-4d2a-a434-df3f2083b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.148359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7fb5f-eded-4d2a-a434-df3f2083b759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.149134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7fb5f-eded-4d2a-a434-df3f2083b759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.151389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7fb5f-eded-4d2a-a434-df3f2083b759 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.151904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1138/2274] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:24.170311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:24.226860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1137/2275] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:24 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:41:24.230751 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c50f6e-693a-45aa-afc3-51ce2c7661d8 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:24.252183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c50f6e-693a-45aa-afc3-51ce2c7661d8 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.359859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a24f6-dc02-4ee7-894c-cbcfd8662c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.360739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a24f6-dc02-4ee7-894c-cbcfd8662c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.361087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a24f6-dc02-4ee7-894c-cbcfd8662c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.361507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a24f6-dc02-4ee7-894c-cbcfd8662c01 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.362565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a24f6-dc02-4ee7-894c-cbcfd8662c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.365403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a24f6-dc02-4ee7-894c-cbcfd8662c01 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.421550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1139/2276] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:24 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:24.424492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7fb5f-eded-4d2a-a434-df3f2083b759 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:24.437730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7fb5f-eded-4d2a-a434-df3f2083b759 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.443048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ba30b-c18e-4997-9eda-e06e4afd65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.443856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ba30b-c18e-4997-9eda-e06e4afd65b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.444289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ba30b-c18e-4997-9eda-e06e4afd65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.444693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ba30b-c18e-4997-9eda-e06e4afd65b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.445767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ba30b-c18e-4997-9eda-e06e4afd65b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.448155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ba30b-c18e-4997-9eda-e06e4afd65b2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.463883 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1138/2277] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:24.467876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a24f6-dc02-4ee7-894c-cbcfd8662c01 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:24.491560 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a24f6-dc02-4ee7-894c-cbcfd8662c01 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.518602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764db2b-d0aa-4338-922d-5052e77efe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.519749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764db2b-d0aa-4338-922d-5052e77efe1b admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.520150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764db2b-d0aa-4338-922d-5052e77efe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.530579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764db2b-d0aa-4338-922d-5052e77efe1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.531860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764db2b-d0aa-4338-922d-5052e77efe1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.533895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764db2b-d0aa-4338-922d-5052e77efe1b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.571403 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1140/2278] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:24.575323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ba30b-c18e-4997-9eda-e06e4afd65b2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:24.597478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ba30b-c18e-4997-9eda-e06e4afd65b2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.609871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.612489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.613201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.613940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] PATH_INFO: `/v3/projects/83349955b3ce4989b4bbe18c20899952/users/fb6502ced3cc421c8a4f5bcedc48ea65/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.634285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83349955b3ce4989b4bbe18c20899952, user_id=fb6502ced3cc421c8a4f5bcedc48ea65, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.638537 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.657552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1139/2279] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:24 2022] PUT /identity/v3/projects/83349955b3ce4989b4bbe18c20899952/users/fb6502ced3cc421c8a4f5bcedc48ea65/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:24.670809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95fac5-c9f3-49fa-9841-f4e873a26c39 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.671458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95fac5-c9f3-49fa-9841-f4e873a26c39 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.671458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95fac5-c9f3-49fa-9841-f4e873a26c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.739250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-9a95fac5-c9f3-49fa-9841-f4e873a26c39 None None] MFA Rules not processed for user `fb6502ced3cc421c8a4f5bcedc48ea65`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:24.740917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9a95fac5-c9f3-49fa-9841-f4e873a26c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:24.752545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:24.754496 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:24.767882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:24.881007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1141/2280] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:24.883564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95fac5-c9f3-49fa-9841-f4e873a26c39 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:24.885800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0891332-6c94-48c3-b233-64a400aa55f3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.894272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.895032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.895396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.895750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] PATH_INFO: `/v3/projects/3705597a04084d64924e05397fe21e8a` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.901758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95fac5-c9f3-49fa-9841-f4e873a26c39 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:24.902427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3705597a04084d64924e05397fe21e8a)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.904779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.913144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3db1-12ed-4f88-899e-6e8a3380f2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:24.914478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3db1-12ed-4f88-899e-6e8a3380f2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:24.914959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3db1-12ed-4f88-899e-6e8a3380f2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:24.915593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3db1-12ed-4f88-899e-6e8a3380f2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:24.916457 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3db1-12ed-4f88-899e-6e8a3380f2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:24.918555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3db1-12ed-4f88-899e-6e8a3380f2d0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:24.974381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1142/2281] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:24 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:24.979220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3db1-12ed-4f88-899e-6e8a3380f2d0 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.016143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3705597a04084d64924e05397fe21e8a', 'request_id': 'req-e982dcfc-c192-4e6b-b11b-65183bc66590'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:25.052107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3705597a04084d64924e05397fe21e8a', 'request_id': 'req-e982dcfc-c192-4e6b-b11b-65183bc66590'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:25.081042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3705597a04084d64924e05397fe21e8a', 'request_id': 'req-e982dcfc-c192-4e6b-b11b-65183bc66590'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:25.120910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] The token cache is being invalidate because project 3705597a04084d64924e05397fe21e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:25.121251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:25.125153 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-e982dcfc-c192-4e6b-b11b-65183bc66590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:25.133670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1140/2282] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:24 2022] DELETE /identity/v3/projects/3705597a04084d64924e05397fe21e8a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:25.135870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da496-2d9b-4076-8f9c-0d0be243c5d4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.136221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da496-2d9b-4076-8f9c-0d0be243c5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.136563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498da496-2d9b-4076-8f9c-0d0be243c5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.173112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3db1-12ed-4f88-899e-6e8a3380f2d0 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.196500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-498da496-2d9b-4076-8f9c-0d0be243c5d4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:25.202870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-498da496-2d9b-4076-8f9c-0d0be243c5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:25.294690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:25.312836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.314114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.314410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.314696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.315365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.317392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.357100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1141/2283] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:25.360758 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc4df0-d569-464b-af2c-751d02e74d89 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.361139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc4df0-d569-464b-af2c-751d02e74d89 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.361423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc4df0-d569-464b-af2c-751d02e74d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.397025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1143/2284] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:24 2022] POST /identity/v3/users => generated 295 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:25.404502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.407615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:25.417213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e8dc4df0-d569-464b-af2c-751d02e74d89 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:25.418795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e8dc4df0-d569-464b-af2c-751d02e74d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:25.421628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4f1fb-1463-4d4c-bcf5-b5557de7fd63 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.426863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d035219-5d5e-485f-adf8-9418f8007819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.427497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035219-5d5e-485f-adf8-9418f8007819 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.427779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035219-5d5e-485f-adf8-9418f8007819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.428056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035219-5d5e-485f-adf8-9418f8007819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.429264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d035219-5d5e-485f-adf8-9418f8007819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.430950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d035219-5d5e-485f-adf8-9418f8007819 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.434150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1142/2285] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:25.437588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc4df0-d569-464b-af2c-751d02e74d89 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.459739 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1144/2286] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:25.460752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d035219-5d5e-485f-adf8-9418f8007819 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.464847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc4df0-d569-464b-af2c-751d02e74d89 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.483439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.484081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.484472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.484755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.485581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:41:25.485898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.488298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.490351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d035219-5d5e-485f-adf8-9418f8007819 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.495271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab9784-9706-43c7-b2c3-2d784139f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.495945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9784-9706-43c7-b2c3-2d784139f29e admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.496225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9784-9706-43c7-b2c3-2d784139f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.496522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab9784-9706-43c7-b2c3-2d784139f29e admin admin] PATH_INFO: `/v3/projects/1caa60e229014cc9a34aa77594b70871/users/35f9abf5319d400aac7262f9cfc7a020/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.509393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1143/2287] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:41:25.510818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.516082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:25.521786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab9784-9706-43c7-b2c3-2d784139f29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1caa60e229014cc9a34aa77594b70871, user_id=35f9abf5319d400aac7262f9cfc7a020, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.525467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab9784-9706-43c7-b2c3-2d784139f29e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.531132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012592a-890a-4f30-bfcc-1be2271c87e6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.537162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09c0e9-e357-4fce-adc6-54cf3fc8bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.538422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09c0e9-e357-4fce-adc6-54cf3fc8bbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.538740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09c0e9-e357-4fce-adc6-54cf3fc8bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.539197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09c0e9-e357-4fce-adc6-54cf3fc8bbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.542326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09c0e9-e357-4fce-adc6-54cf3fc8bbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.544463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09c0e9-e357-4fce-adc6-54cf3fc8bbd9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.548285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1145/2288] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:25 2022] PUT /identity/v3/projects/1caa60e229014cc9a34aa77594b70871/users/35f9abf5319d400aac7262f9cfc7a020/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:25.558183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab9784-9706-43c7-b2c3-2d784139f29e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.597381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1144/2289] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:25 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:25.598590 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09c0e9-e357-4fce-adc6-54cf3fc8bbd9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.650337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab9784-9706-43c7-b2c3-2d784139f29e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.731363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09c0e9-e357-4fce-adc6-54cf3fc8bbd9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.742639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31315788-8268-4eea-9fab-9b6d62b7dcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.743971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31315788-8268-4eea-9fab-9b6d62b7dcff admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.744940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31315788-8268-4eea-9fab-9b6d62b7dcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.746278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31315788-8268-4eea-9fab-9b6d62b7dcff admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.747711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31315788-8268-4eea-9fab-9b6d62b7dcff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.748155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f43cb-f79d-470a-a2d7-a8fac205230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.748820 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f43cb-f79d-470a-a2d7-a8fac205230f admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.749112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f43cb-f79d-470a-a2d7-a8fac205230f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.749387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f43cb-f79d-470a-a2d7-a8fac205230f admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.750071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f43cb-f79d-470a-a2d7-a8fac205230f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.751703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f43cb-f79d-470a-a2d7-a8fac205230f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.753802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31315788-8268-4eea-9fab-9b6d62b7dcff admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.765657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1146/2290] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:25.771131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f43cb-f79d-470a-a2d7-a8fac205230f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.784213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f43cb-f79d-470a-a2d7-a8fac205230f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.789582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e55c5-d3c8-4754-87a0-c325fbbc6cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.790495 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e55c5-d3c8-4754-87a0-c325fbbc6cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.791090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e55c5-d3c8-4754-87a0-c325fbbc6cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.791258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e55c5-d3c8-4754-87a0-c325fbbc6cc7 admin admin] PATH_INFO: `/v3/projects/1caa60e229014cc9a34aa77594b70871/users/35f9abf5319d400aac7262f9cfc7a020/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.791990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1145/2291] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:25 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:25.793811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e55c5-d3c8-4754-87a0-c325fbbc6cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1caa60e229014cc9a34aa77594b70871, user_id=35f9abf5319d400aac7262f9cfc7a020, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.797061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e55c5-d3c8-4754-87a0-c325fbbc6cc7 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.798383 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31315788-8268-4eea-9fab-9b6d62b7dcff admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.813616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31315788-8268-4eea-9fab-9b6d62b7dcff admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.821793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1147/2292] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:25 2022] PUT /identity/v3/projects/1caa60e229014cc9a34aa77594b70871/users/35f9abf5319d400aac7262f9cfc7a020/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:25.824819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381e05-2976-466a-afd2-7e6f510fa5ff None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.825169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381e05-2976-466a-afd2-7e6f510fa5ff None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.825505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c381e05-2976-466a-afd2-7e6f510fa5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.875924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7c381e05-2976-466a-afd2-7e6f510fa5ff None None] MFA Rules not processed for user `35f9abf5319d400aac7262f9cfc7a020`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:25.877151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7c381e05-2976-466a-afd2-7e6f510fa5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:25.938919 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d208a3-0acd-4dbb-ac7d-c1b8ba380e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.939553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d208a3-0acd-4dbb-ac7d-c1b8ba380e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.939970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d208a3-0acd-4dbb-ac7d-c1b8ba380e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.940431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d208a3-0acd-4dbb-ac7d-c1b8ba380e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.941236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d208a3-0acd-4dbb-ac7d-c1b8ba380e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.942879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d208a3-0acd-4dbb-ac7d-c1b8ba380e6d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:25.964323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1146/2293] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:25.970605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d208a3-0acd-4dbb-ac7d-c1b8ba380e6d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:25.983136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d208a3-0acd-4dbb-ac7d-c1b8ba380e6d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:25.988989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c3a48-e698-4dc7-baa5-2c5069b31b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:25.989654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c3a48-e698-4dc7-baa5-2c5069b31b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:25.989942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c3a48-e698-4dc7-baa5-2c5069b31b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:25.991662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c3a48-e698-4dc7-baa5-2c5069b31b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:25.992370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c3a48-e698-4dc7-baa5-2c5069b31b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:25.992519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1148/2294] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:25.994046 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c3a48-e698-4dc7-baa5-2c5069b31b84 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:26.006302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c381e05-2976-466a-afd2-7e6f510fa5ff None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:26.009293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7c381e05-2976-466a-afd2-7e6f510fa5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:26.015075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1147/2295] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:41:26.020320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c3a48-e698-4dc7-baa5-2c5069b31b84 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:26.024794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:26.035328 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c3a48-e698-4dc7-baa5-2c5069b31b84 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:26.045559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b1c40-ab84-4a98-9355-f589b0199a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:26.046438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b1c40-ab84-4a98-9355-f589b0199a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:26.046892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b1c40-ab84-4a98-9355-f589b0199a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:26.047410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b1c40-ab84-4a98-9355-f589b0199a5b admin admin] PATH_INFO: `/v3/projects/de571cedb2a146c5966def59c12d8f6d/users/7498ac0161a947b18557931a6dd042d5/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:26.071775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b1c40-ab84-4a98-9355-f589b0199a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=de571cedb2a146c5966def59c12d8f6d, user_id=7498ac0161a947b18557931a6dd042d5, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:26.075032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b1c40-ab84-4a98-9355-f589b0199a5b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:26.079280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:26.100150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1148/2296] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:26 2022] PUT /identity/v3/projects/de571cedb2a146c5966def59c12d8f6d/users/7498ac0161a947b18557931a6dd042d5/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:26.107564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c6bb-e96e-4cc6-9faf-726a19946aa3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:26.108323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c6bb-e96e-4cc6-9faf-726a19946aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:26.108607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c6bb-e96e-4cc6-9faf-726a19946aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:26.136213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c6f4c6bb-e96e-4cc6-9faf-726a19946aa3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:26.137444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c6f4c6bb-e96e-4cc6-9faf-726a19946aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:26.160911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c381e05-2976-466a-afd2-7e6f510fa5ff None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:26.248110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1149/2297] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:26.265089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c6bb-e96e-4cc6-9faf-726a19946aa3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:26.266838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c6f4c6bb-e96e-4cc6-9faf-726a19946aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:26.331244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aed401-f997-40c4-b564-c9697bae4418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:26.332003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed401-f997-40c4-b564-c9697bae4418 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:26.332371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed401-f997-40c4-b564-c9697bae4418 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:26.332757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed401-f997-40c4-b564-c9697bae4418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:26.336009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-28aed401-f997-40c4-b564-c9697bae4418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:26.387831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c6bb-e96e-4cc6-9faf-726a19946aa3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:26.393191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39a2d9-0863-4e7e-8b5d-203a636f20c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:26.394157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a2d9-0863-4e7e-8b5d-203a636f20c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:26.394505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a2d9-0863-4e7e-8b5d-203a636f20c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:26.395361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39a2d9-0863-4e7e-8b5d-203a636f20c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:26.408636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39a2d9-0863-4e7e-8b5d-203a636f20c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:26.410266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39a2d9-0863-4e7e-8b5d-203a636f20c9 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:26.446787 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1150/2298] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:41:26.477910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aed401-f997-40c4-b564-c9697bae4418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:26.485498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aed401-f997-40c4-b564-c9697bae4418 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:26.512273 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1149/2299] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:41:29.803125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39a2d9-0863-4e7e-8b5d-203a636f20c9 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:29.816911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39a2d9-0863-4e7e-8b5d-203a636f20c9 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:29.826358 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f68a-0404-45c8-9aed-542f7235e85d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:29.827125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f68a-0404-45c8-9aed-542f7235e85d service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:29.827405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f68a-0404-45c8-9aed-542f7235e85d service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:29.827679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f68a-0404-45c8-9aed-542f7235e85d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:29.968360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f68a-0404-45c8-9aed-542f7235e85d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:29.971653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f68a-0404-45c8-9aed-542f7235e85d service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:29.992074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1151/2300] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:33.770123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3323-20bc-4435-b74c-dd7314943c49 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:33.770611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3323-20bc-4435-b74c-dd7314943c49 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:33.770723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3323-20bc-4435-b74c-dd7314943c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:33.817292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-333c3323-20bc-4435-b74c-dd7314943c49 None None] MFA Rules not processed for user `7498ac0161a947b18557931a6dd042d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:33.818796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-333c3323-20bc-4435-b74c-dd7314943c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:33.920991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1150/2301] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:33.924152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f68a-0404-45c8-9aed-542f7235e85d service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:33.948517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f68a-0404-45c8-9aed-542f7235e85d service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:33.961423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc2cf8-ca46-4b27-aea1-9b3690885fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:33.962518 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc2cf8-ca46-4b27-aea1-9b3690885fab admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:33.963893 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc2cf8-ca46-4b27-aea1-9b3690885fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:33.964125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc2cf8-ca46-4b27-aea1-9b3690885fab admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:33.965228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc2cf8-ca46-4b27-aea1-9b3690885fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:33.970342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc2cf8-ca46-4b27-aea1-9b3690885fab admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:34.026168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1152/2302] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:33 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:34.028774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3323-20bc-4435-b74c-dd7314943c49 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:34.043903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:34.056508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3323-20bc-4435-b74c-dd7314943c49 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:34.205620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa2971-682e-4463-ab59-93cbaad2308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:34.206687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa2971-682e-4463-ab59-93cbaad2308b admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:34.207060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa2971-682e-4463-ab59-93cbaad2308b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:34.207440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa2971-682e-4463-ab59-93cbaad2308b admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:34.210596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa2971-682e-4463-ab59-93cbaad2308b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:34.219892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa2971-682e-4463-ab59-93cbaad2308b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:34.264129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1151/2303] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:34 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:34.277883 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc2cf8-ca46-4b27-aea1-9b3690885fab admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:34.294530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc2cf8-ca46-4b27-aea1-9b3690885fab admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:34.302252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cee622-977e-4afc-a542-3438e82dd9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:34.303027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee622-977e-4afc-a542-3438e82dd9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:34.303488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee622-977e-4afc-a542-3438e82dd9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:34.303871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cee622-977e-4afc-a542-3438e82dd9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:34.304929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cee622-977e-4afc-a542-3438e82dd9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:34.306781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cee622-977e-4afc-a542-3438e82dd9e5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:34.322351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:34.347617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1153/2304] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:34.352155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa2971-682e-4463-ab59-93cbaad2308b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:34.385835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa2971-682e-4463-ab59-93cbaad2308b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:34.401363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaf1ad-1e79-4830-8348-38181afea26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:34.402204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf1ad-1e79-4830-8348-38181afea26e admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:34.402569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf1ad-1e79-4830-8348-38181afea26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:34.402948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf1ad-1e79-4830-8348-38181afea26e admin admin] PATH_INFO: `/v3/projects/0fd37b2cad2c47a4ada0a7cfa3c49116/users/70218f468eaa45518541d79151d00b2d/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:34.437850 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaf1ad-1e79-4830-8348-38181afea26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd37b2cad2c47a4ada0a7cfa3c49116, user_id=70218f468eaa45518541d79151d00b2d, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:34.440843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaf1ad-1e79-4830-8348-38181afea26e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:34.478857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1152/2305] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:34 2022] PUT /identity/v3/projects/0fd37b2cad2c47a4ada0a7cfa3c49116/users/70218f468eaa45518541d79151d00b2d/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:34.483112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cee622-977e-4afc-a542-3438e82dd9e5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:34.499565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cee622-977e-4afc-a542-3438e82dd9e5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:34.650839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213738e-f462-4ca6-ba16-c73a2b1840aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:34.651484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213738e-f462-4ca6-ba16-c73a2b1840aa admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:34.651842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213738e-f462-4ca6-ba16-c73a2b1840aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:34.652126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213738e-f462-4ca6-ba16-c73a2b1840aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:34.652874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213738e-f462-4ca6-ba16-c73a2b1840aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:34.654631 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213738e-f462-4ca6-ba16-c73a2b1840aa admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:34.677758 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1154/2306] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:34.679521 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaf1ad-1e79-4830-8348-38181afea26e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:34.695251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaf1ad-1e79-4830-8348-38181afea26e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:34.715765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:34.716459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:34.717112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:34.717112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] PATH_INFO: `/v3/projects/0fd37b2cad2c47a4ada0a7cfa3c49116/users/70218f468eaa45518541d79151d00b2d/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:34.719159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd37b2cad2c47a4ada0a7cfa3c49116, user_id=70218f468eaa45518541d79151d00b2d, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:34.721860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:34.744798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1153/2307] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:34 2022] PUT /identity/v3/projects/0fd37b2cad2c47a4ada0a7cfa3c49116/users/70218f468eaa45518541d79151d00b2d/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:41.721460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df026-3105-44e8-a9ab-a94404a706d0 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:41.721946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df026-3105-44e8-a9ab-a94404a706d0 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:41.722044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78df026-3105-44e8-a9ab-a94404a706d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:41.775057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b78df026-3105-44e8-a9ab-a94404a706d0 None None] MFA Rules not processed for user `70218f468eaa45518541d79151d00b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:41.776317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b78df026-3105-44e8-a9ab-a94404a706d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:41.903432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1155/2308] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:41.922330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:41.924196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:42.057727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba97f66-d041-4fd3-954c-40628dd6981e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:42.066167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd3aa-4fbf-4060-b6f2-2434ebc3ecf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:42.066815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd3aa-4fbf-4060-b6f2-2434ebc3ecf8 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:42.067101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd3aa-4fbf-4060-b6f2-2434ebc3ecf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:42.067771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd3aa-4fbf-4060-b6f2-2434ebc3ecf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:42.199173 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:42.205258 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cd3aa-4fbf-4060-b6f2-2434ebc3ecf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:42.207731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cd3aa-4fbf-4060-b6f2-2434ebc3ecf8 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:42.240652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1154/2309] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:44.155709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55dbfb-3fc6-411e-83fc-b9d3175f68d4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:44.156377 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55dbfb-3fc6-411e-83fc-b9d3175f68d4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:44.156377 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55dbfb-3fc6-411e-83fc-b9d3175f68d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:44.177978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9e55dbfb-3fc6-411e-83fc-b9d3175f68d4 None None] MFA Rules not processed for user `7498ac0161a947b18557931a6dd042d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:44.179697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9e55dbfb-3fc6-411e-83fc-b9d3175f68d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:44.187949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1156/2310] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:45.015900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd3aa-4fbf-4060-b6f2-2434ebc3ecf8 service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:45.096848 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd3aa-4fbf-4060-b6f2-2434ebc3ecf8 service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:45.102365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:45.103008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:45.103292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:45.103571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] PATH_INFO: `/v3/users/fb6502ced3cc421c8a4f5bcedc48ea65` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:45.104716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6502ced3cc421c8a4f5bcedc48ea65)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:45.106708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:45.161351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6502ced3cc421c8a4f5bcedc48ea65'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:45.169120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6502ced3cc421c8a4f5bcedc48ea65'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:45.170039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6502ced3cc421c8a4f5bcedc48ea65'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:45.170718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6502ced3cc421c8a4f5bcedc48ea65'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:45.180655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6502ced3cc421c8a4f5bcedc48ea65'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:45.214784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1155/2311] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:45 2022] DELETE /identity/v3/users/fb6502ced3cc421c8a4f5bcedc48ea65 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:41:45.219272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018019-1ce1-4cb9-bb8d-fdc26cbe9c45 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:45.219781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018019-1ce1-4cb9-bb8d-fdc26cbe9c45 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:45.219985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018019-1ce1-4cb9-bb8d-fdc26cbe9c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:45.246667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-98018019-1ce1-4cb9-bb8d-fdc26cbe9c45 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:45.248555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-98018019-1ce1-4cb9-bb8d-fdc26cbe9c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:45.347091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1157/2312] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:45.358360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:45.360218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:45.445343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93969cb-f9de-4e9f-a758-b7055eb5bb59 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:45.449473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:45.451150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:45.451439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:45.451722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:45.463936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:45.465402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:45.476719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1156/2313] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:45.713226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80a7e-18a8-4b1b-ac66-b3e5c65879cd None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:45.713856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80a7e-18a8-4b1b-ac66-b3e5c65879cd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:45.713856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80a7e-18a8-4b1b-ac66-b3e5c65879cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:45.745771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-e4f80a7e-18a8-4b1b-ac66-b3e5c65879cd None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:45.747282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e4f80a7e-18a8-4b1b-ac66-b3e5c65879cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:45.758928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:45.873942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1158/2314] 10.222.0.17 () {58 vars in 967 bytes} [Mon Oct 3 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:45.887079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:45.888654 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:45.923064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:46.027499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef12d7-0e25-4c3b-a911-7e1de38e158e service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:46.033813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00d3ea-be56-4d82-ac7d-dc6bfdbd02ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:46.034777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00d3ea-be56-4d82-ac7d-dc6bfdbd02ab service swift] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:46.035186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00d3ea-be56-4d82-ac7d-dc6bfdbd02ab service swift] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:46.035605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00d3ea-be56-4d82-ac7d-dc6bfdbd02ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:46.043832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f80a7e-18a8-4b1b-ac66-b3e5c65879cd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:46.043832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e4f80a7e-18a8-4b1b-ac66-b3e5c65879cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:46.052302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00d3ea-be56-4d82-ac7d-dc6bfdbd02ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:46.054168 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c00d3ea-be56-4d82-ac7d-dc6bfdbd02ab service swift] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:46.065998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1157/2315] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:41:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:41:46.108788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f80a7e-18a8-4b1b-ac66-b3e5c65879cd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:46.125596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:46.126284 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:46.126576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:46.126857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] PATH_INFO: `/v3/projects/83349955b3ce4989b4bbe18c20899952` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:46.128163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=83349955b3ce4989b4bbe18c20899952)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:46.130158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:46.245487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83349955b3ce4989b4bbe18c20899952', 'request_id': 'req-cac5524b-58b4-462e-92f5-0b754853d2ef'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.262995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83349955b3ce4989b4bbe18c20899952', 'request_id': 'req-cac5524b-58b4-462e-92f5-0b754853d2ef'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.270504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83349955b3ce4989b4bbe18c20899952', 'request_id': 'req-cac5524b-58b4-462e-92f5-0b754853d2ef'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.292141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] The token cache is being invalidate because project 83349955b3ce4989b4bbe18c20899952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:46.292677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.293754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.296119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1159/2316] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:46 2022] DELETE /identity/v3/projects/83349955b3ce4989b4bbe18c20899952 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:46.301685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00d3ea-be56-4d82-ac7d-dc6bfdbd02ab service swift] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:46.316630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00d3ea-be56-4d82-ac7d-dc6bfdbd02ab service swift] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:46.408727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:46.409457 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:46.409846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:46.410197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] PATH_INFO: `/v3/users/35f9abf5319d400aac7262f9cfc7a020` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:46.411637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f9abf5319d400aac7262f9cfc7a020)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:46.418630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:46.495023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f9abf5319d400aac7262f9cfc7a020'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.507538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f9abf5319d400aac7262f9cfc7a020'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.508595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f9abf5319d400aac7262f9cfc7a020'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.509950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f9abf5319d400aac7262f9cfc7a020'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.520634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e0766d24-e49b-4ed7-98d5-4117a469788f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f9abf5319d400aac7262f9cfc7a020'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:46.570935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1158/2317] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:46 2022] DELETE /identity/v3/users/35f9abf5319d400aac7262f9cfc7a020 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:46.950308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:46.953329 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:46.981682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5524b-58b4-462e-92f5-0b754853d2ef admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:47.069942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:47.070646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.070930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.071251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] PATH_INFO: `/v3/projects/1caa60e229014cc9a34aa77594b70871` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.072681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1caa60e229014cc9a34aa77594b70871)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:47.074781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:47.134938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:47.140135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1caa60e229014cc9a34aa77594b70871', 'request_id': 'req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:47.150039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1caa60e229014cc9a34aa77594b70871', 'request_id': 'req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:47.157164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1caa60e229014cc9a34aa77594b70871', 'request_id': 'req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:47.169471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] The token cache is being invalidate because project 1caa60e229014cc9a34aa77594b70871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:47.169804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:47.170465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8ad06a7c-465a-4041-b03e-0e8fdb6c45a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:47.172286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1160/2318] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:46 2022] DELETE /identity/v3/projects/1caa60e229014cc9a34aa77594b70871 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:47.177031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce454d2-41e3-4ee2-ba51-d6fd9a4ebddc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.177581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce454d2-41e3-4ee2-ba51-d6fd9a4ebddc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.177677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce454d2-41e3-4ee2-ba51-d6fd9a4ebddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.202110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-fce454d2-41e3-4ee2-ba51-d6fd9a4ebddc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:47.203682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-fce454d2-41e3-4ee2-ba51-d6fd9a4ebddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:47.224190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:47.282015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1159/2319] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:47.287010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4230aa-079b-4b9b-b3c1-a16851ab2044 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.287582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4230aa-079b-4b9b-b3c1-a16851ab2044 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.287667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4230aa-079b-4b9b-b3c1-a16851ab2044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.308658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ac4230aa-079b-4b9b-b3c1-a16851ab2044 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:47.309961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ac4230aa-079b-4b9b-b3c1-a16851ab2044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:47.319366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1161/2320] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:47.323770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce454d2-41e3-4ee2-ba51-d6fd9a4ebddc None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:47.339115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce454d2-41e3-4ee2-ba51-d6fd9a4ebddc None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:47.344136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:47.344830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.345205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.345658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.346225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:41:47.346548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:47.348340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:47.364414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1160/2321] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:41:47.366535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4230aa-079b-4b9b-b3c1-a16851ab2044 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:47.376328 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4230aa-079b-4b9b-b3c1-a16851ab2044 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:47.381984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6955-3410-49fb-adbd-ea7628775360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:47.382736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6955-3410-49fb-adbd-ea7628775360 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.383112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6955-3410-49fb-adbd-ea7628775360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.383462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6955-3410-49fb-adbd-ea7628775360 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.384273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc6955-3410-49fb-adbd-ea7628775360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:47.386693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc6955-3410-49fb-adbd-ea7628775360 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:47.423058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1162/2322] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:47 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:41:47.427483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:47.439020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd55b2-2781-461f-88c5-9a49fa358169 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:47.500628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de4713-d2c5-4d21-8cf8-6389d90e22c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:47.501264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4713-d2c5-4d21-8cf8-6389d90e22c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.501582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4713-d2c5-4d21-8cf8-6389d90e22c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.501892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de4713-d2c5-4d21-8cf8-6389d90e22c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.502627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de4713-d2c5-4d21-8cf8-6389d90e22c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:47.504553 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de4713-d2c5-4d21-8cf8-6389d90e22c0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:47.529311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1161/2323] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:47 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:47.536279 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6955-3410-49fb-adbd-ea7628775360 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:47.552576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6955-3410-49fb-adbd-ea7628775360 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:47.560246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc81441-b79f-4ddf-925e-3212acd17baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:47.561191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81441-b79f-4ddf-925e-3212acd17baa admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.561474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81441-b79f-4ddf-925e-3212acd17baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.561778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc81441-b79f-4ddf-925e-3212acd17baa admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.562425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc81441-b79f-4ddf-925e-3212acd17baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:47.564268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc81441-b79f-4ddf-925e-3212acd17baa admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:47.580786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1163/2324] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:47.581961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de4713-d2c5-4d21-8cf8-6389d90e22c0 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:47.593901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de4713-d2c5-4d21-8cf8-6389d90e22c0 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:47.609659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c52cf4-0c3d-4fa8-b777-080d96cbb326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:47.610515 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52cf4-0c3d-4fa8-b777-080d96cbb326 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.610888 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52cf4-0c3d-4fa8-b777-080d96cbb326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.611263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52cf4-0c3d-4fa8-b777-080d96cbb326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.612045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c52cf4-0c3d-4fa8-b777-080d96cbb326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:47.613894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c52cf4-0c3d-4fa8-b777-080d96cbb326 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:47.626574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1162/2325] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:41:47.630927 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc81441-b79f-4ddf-925e-3212acd17baa admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:47.643149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc81441-b79f-4ddf-925e-3212acd17baa admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:47.648091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439e2be-ad75-49d5-8a8a-ad1d30b4635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:47.648832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439e2be-ad75-49d5-8a8a-ad1d30b4635c admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.649181 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439e2be-ad75-49d5-8a8a-ad1d30b4635c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.649608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439e2be-ad75-49d5-8a8a-ad1d30b4635c admin admin] PATH_INFO: `/v3/projects/71863f89b92e488cac21b5c4c74ce525/users/532a03da5a584c41927df711d180bfad/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.665928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439e2be-ad75-49d5-8a8a-ad1d30b4635c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71863f89b92e488cac21b5c4c74ce525, user_id=532a03da5a584c41927df711d180bfad, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:47.668842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439e2be-ad75-49d5-8a8a-ad1d30b4635c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:47.696170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1164/2326] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:47 2022] PUT /identity/v3/projects/71863f89b92e488cac21b5c4c74ce525/users/532a03da5a584c41927df711d180bfad/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:41:47.707504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a74a72-e930-45bf-a1a2-2014faa24976 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.707693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a74a72-e930-45bf-a1a2-2014faa24976 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.707964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a74a72-e930-45bf-a1a2-2014faa24976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.739436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-d8a74a72-e930-45bf-a1a2-2014faa24976 None None] MFA Rules not processed for user `532a03da5a584c41927df711d180bfad`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:47.741209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d8a74a72-e930-45bf-a1a2-2014faa24976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:47.827698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1163/2327] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:47.833256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439e2be-ad75-49d5-8a8a-ad1d30b4635c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:47.917131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439e2be-ad75-49d5-8a8a-ad1d30b4635c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:47.924038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79d59e-39a4-4e93-b01f-4269c664cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:47.924667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79d59e-39a4-4e93-b01f-4269c664cab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:47.924952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79d59e-39a4-4e93-b01f-4269c664cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:47.925231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79d59e-39a4-4e93-b01f-4269c664cab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:47.925945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79d59e-39a4-4e93-b01f-4269c664cab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:47.928053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79d59e-39a4-4e93-b01f-4269c664cab0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:47.964834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1165/2328] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:47 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:41:47.969020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a74a72-e930-45bf-a1a2-2014faa24976 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:47.982526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a74a72-e930-45bf-a1a2-2014faa24976 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.003620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:48.067659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8839d1-c1d3-4424-b34e-9b115a18c438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.068377 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8839d1-c1d3-4424-b34e-9b115a18c438 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.068721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8839d1-c1d3-4424-b34e-9b115a18c438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.069010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8839d1-c1d3-4424-b34e-9b115a18c438 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.069701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8839d1-c1d3-4424-b34e-9b115a18c438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:48.071709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8839d1-c1d3-4424-b34e-9b115a18c438 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:48.099364 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1164/2329] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:47 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:48.104613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79d59e-39a4-4e93-b01f-4269c664cab0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:48.133036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79d59e-39a4-4e93-b01f-4269c664cab0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.139394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1138f4-e152-40ce-9158-b05d9e078f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.140033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1138f4-e152-40ce-9158-b05d9e078f4e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.140308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1138f4-e152-40ce-9158-b05d9e078f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.140586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1138f4-e152-40ce-9158-b05d9e078f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.141240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1138f4-e152-40ce-9158-b05d9e078f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:48.143074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1138f4-e152-40ce-9158-b05d9e078f4e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:48.160882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1166/2330] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:41:48.165321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8839d1-c1d3-4424-b34e-9b115a18c438 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:48.176048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8839d1-c1d3-4424-b34e-9b115a18c438 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.186463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.187148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.187434 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.188098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] PATH_INFO: `/v3/projects/70446026297540c6a3d9f01810939bb2/users/8b486943762449ce9b2a7dfe49ae57a0/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.205992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70446026297540c6a3d9f01810939bb2, user_id=8b486943762449ce9b2a7dfe49ae57a0, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:48.209983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:48.238309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1165/2331] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:48 2022] PUT /identity/v3/projects/70446026297540c6a3d9f01810939bb2/users/8b486943762449ce9b2a7dfe49ae57a0/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:48.242652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1138f4-e152-40ce-9158-b05d9e078f4e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:48.263293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1138f4-e152-40ce-9158-b05d9e078f4e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.327911 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:48.366054 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e69d1-fc58-4621-a207-e30daa64ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.367131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e69d1-fc58-4621-a207-e30daa64ebde admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.367559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e69d1-fc58-4621-a207-e30daa64ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.368064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e69d1-fc58-4621-a207-e30daa64ebde admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.368982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e69d1-fc58-4621-a207-e30daa64ebde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:48.371008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e69d1-fc58-4621-a207-e30daa64ebde admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:48.394222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:48.397540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:48.400407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1167/2332] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:48.403741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e69d1-fc58-4621-a207-e30daa64ebde admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:48.422388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca7b26-c177-4110-9cf0-bf0a937a4e4c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.427702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e69d1-fc58-4621-a207-e30daa64ebde admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.429408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.430260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.430646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.431187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] PATH_INFO: `/v3/users/f7bfaa57173c4ef085e517805d8e5e1b` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.432711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bfaa57173c4ef085e517805d8e5e1b)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:48.435248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:48.441535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5f11e-3f57-4232-b17e-429aa73f6bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.442363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f11e-3f57-4232-b17e-429aa73f6bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.442667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f11e-3f57-4232-b17e-429aa73f6bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.442951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f11e-3f57-4232-b17e-429aa73f6bf8 admin admin] PATH_INFO: `/v3/projects/70446026297540c6a3d9f01810939bb2/users/8b486943762449ce9b2a7dfe49ae57a0/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.446205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5f11e-3f57-4232-b17e-429aa73f6bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70446026297540c6a3d9f01810939bb2, user_id=8b486943762449ce9b2a7dfe49ae57a0, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:48.449961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5f11e-3f57-4232-b17e-429aa73f6bf8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:48.464660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1168/2333] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:48 2022] PUT /identity/v3/projects/70446026297540c6a3d9f01810939bb2/users/8b486943762449ce9b2a7dfe49ae57a0/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:48.478161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5519d0-fe55-46c7-bcbe-9f638b24813e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.478723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5519d0-fe55-46c7-bcbe-9f638b24813e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.479158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5519d0-fe55-46c7-bcbe-9f638b24813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.519467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bfaa57173c4ef085e517805d8e5e1b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:48.526323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ab5519d0-fe55-46c7-bcbe-9f638b24813e None None] MFA Rules not processed for user `8b486943762449ce9b2a7dfe49ae57a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:48.527624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ab5519d0-fe55-46c7-bcbe-9f638b24813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:48.532265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bfaa57173c4ef085e517805d8e5e1b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:48.533384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bfaa57173c4ef085e517805d8e5e1b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:48.534635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bfaa57173c4ef085e517805d8e5e1b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:48.556187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bfaa57173c4ef085e517805d8e5e1b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:48.582113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1166/2334] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:48 2022] DELETE /identity/v3/users/f7bfaa57173c4ef085e517805d8e5e1b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:48.655104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1169/2335] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:48.663428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:48.668122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:48.755345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ffbf-7c06-47f5-aaf4-21874af01acc admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.759993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.760892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.761321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.761629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.774967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:48.807456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5519d0-fe55-46c7-bcbe-9f638b24813e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:48.809460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ab5519d0-fe55-46c7-bcbe-9f638b24813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:48.883247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:48.884712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:48.897999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1167/2336] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:41:48.904751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5519d0-fe55-46c7-bcbe-9f638b24813e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.947417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:48.948819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:48.960468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25211683-7be6-42a2-8ead-27cbc0158488 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:48.961992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:48.964542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0961a0f-341d-438a-88a6-7d39a8b3a9fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.965291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961a0f-341d-438a-88a6-7d39a8b3a9fa service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.965727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961a0f-341d-438a-88a6-7d39a8b3a9fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.966009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961a0f-341d-438a-88a6-7d39a8b3a9fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.969559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c0961a0f-341d-438a-88a6-7d39a8b3a9fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:48.974390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:48.975147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:48.975512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:48.975818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] PATH_INFO: `/v3/projects/08b66e624374469b876a10e7c89f3de6` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:48.976996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b66e624374469b876a10e7c89f3de6)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:48.979048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.037184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b66e624374469b876a10e7c89f3de6', 'request_id': 'req-66ad47ed-3999-4d72-bb6c-226b12f5d669'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:49.042191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0961a0f-341d-438a-88a6-7d39a8b3a9fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:49.044394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0961a0f-341d-438a-88a6-7d39a8b3a9fa service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.047406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b66e624374469b876a10e7c89f3de6', 'request_id': 'req-66ad47ed-3999-4d72-bb6c-226b12f5d669'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:49.055248 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1168/2337] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:41:49.056063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b66e624374469b876a10e7c89f3de6', 'request_id': 'req-66ad47ed-3999-4d72-bb6c-226b12f5d669'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:49.067475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] The token cache is being invalidate because project 08b66e624374469b876a10e7c89f3de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:49.067770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:49.068473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66ad47ed-3999-4d72-bb6c-226b12f5d669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:49.070798 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1170/2338] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:48 2022] DELETE /identity/v3/projects/08b66e624374469b876a10e7c89f3de6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:49.075655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e200-73cd-49c4-be2b-1fbc554e2f0e None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.075945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e200-73cd-49c4-be2b-1fbc554e2f0e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.076227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1e200-73cd-49c4-be2b-1fbc554e2f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.097124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7ca1e200-73cd-49c4-be2b-1fbc554e2f0e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:49.098401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7ca1e200-73cd-49c4-be2b-1fbc554e2f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:49.172534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1169/2339] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:49.180836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba9a5-915e-41d6-9b96-efcab2ab401a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.181228 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba9a5-915e-41d6-9b96-efcab2ab401a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.181396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ba9a5-915e-41d6-9b96-efcab2ab401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.202236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-634ba9a5-915e-41d6-9b96-efcab2ab401a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:49.203562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-634ba9a5-915e-41d6-9b96-efcab2ab401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:49.214993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1171/2340] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:49.218809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1e200-73cd-49c4-be2b-1fbc554e2f0e None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:49.231119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1e200-73cd-49c4-be2b-1fbc554e2f0e None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:49.236383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:49.237029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.237315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.237632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.238284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:41:49.238592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:49.240201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.253477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1170/2341] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:41:49.259004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ba9a5-915e-41d6-9b96-efcab2ab401a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:49.269154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ba9a5-915e-41d6-9b96-efcab2ab401a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:49.274197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aa39d-5c49-47b7-8c4d-e8d184f61255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:49.274907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aa39d-5c49-47b7-8c4d-e8d184f61255 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.275048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aa39d-5c49-47b7-8c4d-e8d184f61255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.275335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aa39d-5c49-47b7-8c4d-e8d184f61255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.276160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1aa39d-5c49-47b7-8c4d-e8d184f61255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:49.278584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1aa39d-5c49-47b7-8c4d-e8d184f61255 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.316946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1172/2342] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:49 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:41:49.323072 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:49.336178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4f23c-b1fc-4f57-9d0e-5492188aba43 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:49.374446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:49.410723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a0230-1aa5-4919-96ca-7bfb9695a5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:49.411358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a0230-1aa5-4919-96ca-7bfb9695a5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.411643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a0230-1aa5-4919-96ca-7bfb9695a5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.411920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a0230-1aa5-4919-96ca-7bfb9695a5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.413279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a0230-1aa5-4919-96ca-7bfb9695a5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:49.415466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a0230-1aa5-4919-96ca-7bfb9695a5c1 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.439481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1171/2343] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:49 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:49.444194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aa39d-5c49-47b7-8c4d-e8d184f61255 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:49.456249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aa39d-5c49-47b7-8c4d-e8d184f61255 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:49.461556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885016b8-fe56-47c1-b0f5-e28e3a1a0e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:49.461981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885016b8-fe56-47c1-b0f5-e28e3a1a0e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.462266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885016b8-fe56-47c1-b0f5-e28e3a1a0e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.462540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885016b8-fe56-47c1-b0f5-e28e3a1a0e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.463199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885016b8-fe56-47c1-b0f5-e28e3a1a0e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:49.464908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885016b8-fe56-47c1-b0f5-e28e3a1a0e3d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.476059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1173/2344] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:49.480323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a0230-1aa5-4919-96ca-7bfb9695a5c1 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:49.491965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a0230-1aa5-4919-96ca-7bfb9695a5c1 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:49.497338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d3efb-2ebb-4e01-b3ae-24b7debdb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:49.497991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3efb-2ebb-4e01-b3ae-24b7debdb9bd admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.498295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3efb-2ebb-4e01-b3ae-24b7debdb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.498563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3efb-2ebb-4e01-b3ae-24b7debdb9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.499232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d3efb-2ebb-4e01-b3ae-24b7debdb9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:49.500843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d3efb-2ebb-4e01-b3ae-24b7debdb9bd admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.516992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1172/2345] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:49.522670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885016b8-fe56-47c1-b0f5-e28e3a1a0e3d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:49.533441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885016b8-fe56-47c1-b0f5-e28e3a1a0e3d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:49.539049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:49.539751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.540061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.540349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] PATH_INFO: `/v3/projects/25464e0762e340a2b26ec2a7e031a115/users/eb7d935446c3444eb518498ed4bd01ec/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.557245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25464e0762e340a2b26ec2a7e031a115, user_id=eb7d935446c3444eb518498ed4bd01ec, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:49.560376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.574188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1174/2346] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:49 2022] PUT /identity/v3/projects/25464e0762e340a2b26ec2a7e031a115/users/eb7d935446c3444eb518498ed4bd01ec/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:49.579319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914123-955b-4b8f-840f-4c0397a33995 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.579605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914123-955b-4b8f-840f-4c0397a33995 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.579879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914123-955b-4b8f-840f-4c0397a33995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.599528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-0d914123-955b-4b8f-840f-4c0397a33995 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:49.601216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0d914123-955b-4b8f-840f-4c0397a33995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:49.662015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1173/2347] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:49.672364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:49.674305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:49.736578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e1a7-0e82-480d-8af6-70138719ea49 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:49.740251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:49.740892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:49.741275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:49.741581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:49.750881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:49.752374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:49.762026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1175/2348] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:50.415930 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1955bbf-2563-438d-b1fd-12c6318c08be None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:50.416488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1955bbf-2563-438d-b1fd-12c6318c08be None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:50.416699 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1955bbf-2563-438d-b1fd-12c6318c08be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:50.457784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f1955bbf-2563-438d-b1fd-12c6318c08be None None] MFA Rules not processed for user `eb7d935446c3444eb518498ed4bd01ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:50.457784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f1955bbf-2563-438d-b1fd-12c6318c08be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:50.531395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1174/2349] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:50.542628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:50.544154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:50.597901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:50.645127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700978d4-a9f5-4eaa-8169-47a8016eba69 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:50.653608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:50.654333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:50.654621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:50.654897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:50.664981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:50.666587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:50.676797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1176/2350] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:52.094808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8db44-ca6d-4580-96dd-586e04378eec None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:52.095299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8db44-ca6d-4580-96dd-586e04378eec None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:52.095395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8db44-ca6d-4580-96dd-586e04378eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:52.115334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-fda8db44-ca6d-4580-96dd-586e04378eec None None] MFA Rules not processed for user `eb7d935446c3444eb518498ed4bd01ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:52.117087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-fda8db44-ca6d-4580-96dd-586e04378eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:52.124094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1175/2351] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:52.557754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:52.559642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:52.573025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add2e4d-51d8-4cf4-905c-6c818f00b754 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:52.578082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:52.578935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:52.579216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:52.579488 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] PATH_INFO: `/v3/users/532a03da5a584c41927df711d180bfad` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:52.580672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=532a03da5a584c41927df711d180bfad)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:52.582780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:52.637533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532a03da5a584c41927df711d180bfad'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:52.639538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532a03da5a584c41927df711d180bfad'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:52.648346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532a03da5a584c41927df711d180bfad'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:52.649417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532a03da5a584c41927df711d180bfad'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:52.659615 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532a03da5a584c41927df711d180bfad'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:52.679360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1177/2352] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:52 2022] DELETE /identity/v3/users/532a03da5a584c41927df711d180bfad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:52.683801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24506a9-ff2c-45e6-bfed-ddcac8383ae4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:52.684111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24506a9-ff2c-45e6-bfed-ddcac8383ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:52.684373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24506a9-ff2c-45e6-bfed-ddcac8383ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:52.716093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b24506a9-ff2c-45e6-bfed-ddcac8383ae4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:52.717501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b24506a9-ff2c-45e6-bfed-ddcac8383ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:52.761406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:52.813002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1176/2353] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:52.820971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:52.822492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:52.887171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b6924-7bb5-4888-a738-0206e7c8b49c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:52.890883 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504297fc-a17d-4b3d-be8f-822db831c36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:52.891495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504297fc-a17d-4b3d-be8f-822db831c36a service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:52.891778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504297fc-a17d-4b3d-be8f-822db831c36a service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:52.892050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504297fc-a17d-4b3d-be8f-822db831c36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:52.902449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504297fc-a17d-4b3d-be8f-822db831c36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:52.903885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504297fc-a17d-4b3d-be8f-822db831c36a service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:52.914500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1178/2354] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:53.222152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24506a9-ff2c-45e6-bfed-ddcac8383ae4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:53.223700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b24506a9-ff2c-45e6-bfed-ddcac8383ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:53.236770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24506a9-ff2c-45e6-bfed-ddcac8383ae4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:53.242650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:53.243189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:53.243472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:53.243940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] PATH_INFO: `/v3/projects/71863f89b92e488cac21b5c4c74ce525` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:53.245151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71863f89b92e488cac21b5c4c74ce525)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:53.247120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:53.299860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71863f89b92e488cac21b5c4c74ce525', 'request_id': 'req-a8543a99-336c-4a41-a46f-5de97a4e2553'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.308035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71863f89b92e488cac21b5c4c74ce525', 'request_id': 'req-a8543a99-336c-4a41-a46f-5de97a4e2553'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.315211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71863f89b92e488cac21b5c4c74ce525', 'request_id': 'req-a8543a99-336c-4a41-a46f-5de97a4e2553'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.326599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] The token cache is being invalidate because project 71863f89b92e488cac21b5c4c74ce525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:53.326902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.327559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.329080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1177/2355] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:53 2022] DELETE /identity/v3/projects/71863f89b92e488cac21b5c4c74ce525 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:41:53.333304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504297fc-a17d-4b3d-be8f-822db831c36a service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:53.344662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504297fc-a17d-4b3d-be8f-822db831c36a service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:53.394540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:53.411954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:53.412660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:53.412975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:53.413248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] PATH_INFO: `/v3/users/8b486943762449ce9b2a7dfe49ae57a0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:53.414430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b486943762449ce9b2a7dfe49ae57a0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:53.416360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:53.473069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b486943762449ce9b2a7dfe49ae57a0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.474085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b486943762449ce9b2a7dfe49ae57a0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.481995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b486943762449ce9b2a7dfe49ae57a0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.482661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b486943762449ce9b2a7dfe49ae57a0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.491387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-1ca20b32-0e62-4545-8d99-4f0d3d485bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b486943762449ce9b2a7dfe49ae57a0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.510529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1179/2356] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:41:53 2022] DELETE /identity/v3/users/8b486943762449ce9b2a7dfe49ae57a0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:53.800512 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:53.802712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:53.833484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8543a99-336c-4a41-a46f-5de97a4e2553 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:53.905533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:53.905533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:53.905533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:53.905533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] PATH_INFO: `/v3/projects/70446026297540c6a3d9f01810939bb2` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:53.905989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70446026297540c6a3d9f01810939bb2)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:53.905989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:53.953621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70446026297540c6a3d9f01810939bb2', 'request_id': 'req-63910b9e-2766-4461-8160-a0ee508c6c1e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.961136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70446026297540c6a3d9f01810939bb2', 'request_id': 'req-63910b9e-2766-4461-8160-a0ee508c6c1e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.967570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70446026297540c6a3d9f01810939bb2', 'request_id': 'req-63910b9e-2766-4461-8160-a0ee508c6c1e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.968911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:53.982439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] The token cache is being invalidate because project 70446026297540c6a3d9f01810939bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:41:53.982740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.983410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-63910b9e-2766-4461-8160-a0ee508c6c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:41:53.985005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1178/2357] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:41:53 2022] DELETE /identity/v3/projects/70446026297540c6a3d9f01810939bb2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:53.990037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb3c28-d658-4ed4-a81f-7deaec4e8568 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:53.991051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb3c28-d658-4ed4-a81f-7deaec4e8568 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:53.991259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb3c28-d658-4ed4-a81f-7deaec4e8568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.012899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7eeb3c28-d658-4ed4-a81f-7deaec4e8568 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:54.014264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7eeb3c28-d658-4ed4-a81f-7deaec4e8568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:54.076028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1180/2358] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:41:54.083790 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0353bc-dc93-4cdb-99dc-f9019ce3f217 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.084100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0353bc-dc93-4cdb-99dc-f9019ce3f217 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.084371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0353bc-dc93-4cdb-99dc-f9019ce3f217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.104492 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-bd0353bc-dc93-4cdb-99dc-f9019ce3f217 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:54.106361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-bd0353bc-dc93-4cdb-99dc-f9019ce3f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:54.114271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1179/2359] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:54.119010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb3c28-d658-4ed4-a81f-7deaec4e8568 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.130526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb3c28-d658-4ed4-a81f-7deaec4e8568 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.135940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.136620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.136904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.137213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.137907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:41:54.138217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.139830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.153694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1181/2360] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:41:54.158909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0353bc-dc93-4cdb-99dc-f9019ce3f217 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.169552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0353bc-dc93-4cdb-99dc-f9019ce3f217 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.174313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a70f09-4043-4a0c-bfc5-4223332200e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.174920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a70f09-4043-4a0c-bfc5-4223332200e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.176138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a70f09-4043-4a0c-bfc5-4223332200e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.176138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a70f09-4043-4a0c-bfc5-4223332200e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.176138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a70f09-4043-4a0c-bfc5-4223332200e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.178069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a70f09-4043-4a0c-bfc5-4223332200e2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.215366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1180/2361] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:54 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:54.216567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.228459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd030-39bd-4b8d-b8e3-f070c0b50b53 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.282029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:54.298301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580f34-6b6f-415b-a15f-76c6132595e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.298902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580f34-6b6f-415b-a15f-76c6132595e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.299183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580f34-6b6f-415b-a15f-76c6132595e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.299455 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5580f34-6b6f-415b-a15f-76c6132595e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.300100 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5580f34-6b6f-415b-a15f-76c6132595e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.302139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5580f34-6b6f-415b-a15f-76c6132595e7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.324375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1182/2362] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:54 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:41:54.328859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a70f09-4043-4a0c-bfc5-4223332200e2 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.341420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a70f09-4043-4a0c-bfc5-4223332200e2 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.347653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064eb20-6807-4490-b3b7-5e18ab43044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.348338 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064eb20-6807-4490-b3b7-5e18ab43044b admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.348528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064eb20-6807-4490-b3b7-5e18ab43044b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.348770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064eb20-6807-4490-b3b7-5e18ab43044b admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.349481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064eb20-6807-4490-b3b7-5e18ab43044b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.351660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064eb20-6807-4490-b3b7-5e18ab43044b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.362518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1181/2363] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:54.366931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580f34-6b6f-415b-a15f-76c6132595e7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.378796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5580f34-6b6f-415b-a15f-76c6132595e7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.384167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fadddce-1b50-4fab-977e-c56ff611a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.384788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadddce-1b50-4fab-977e-c56ff611a78f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.385637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadddce-1b50-4fab-977e-c56ff611a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.385637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadddce-1b50-4fab-977e-c56ff611a78f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.386311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadddce-1b50-4fab-977e-c56ff611a78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.388111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fadddce-1b50-4fab-977e-c56ff611a78f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.404521 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1183/2364] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:41:54.405411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064eb20-6807-4490-b3b7-5e18ab43044b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.424664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064eb20-6807-4490-b3b7-5e18ab43044b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.430792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28ba5-8c83-4f58-9d8b-25509f8a059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.431718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28ba5-8c83-4f58-9d8b-25509f8a059f admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.432201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28ba5-8c83-4f58-9d8b-25509f8a059f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.432675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee28ba5-8c83-4f58-9d8b-25509f8a059f admin admin] PATH_INFO: `/v3/projects/8279e86246654a52b0967bf5ac812b68/users/58158e73b41d47f79890a415fec2c95f/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.455007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee28ba5-8c83-4f58-9d8b-25509f8a059f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8279e86246654a52b0967bf5ac812b68, user_id=58158e73b41d47f79890a415fec2c95f, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.461565 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee28ba5-8c83-4f58-9d8b-25509f8a059f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.476165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1182/2365] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:54 2022] PUT /identity/v3/projects/8279e86246654a52b0967bf5ac812b68/users/58158e73b41d47f79890a415fec2c95f/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:54.486515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ad03-1c04-461f-8297-fcc5f68edb82 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.486799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ad03-1c04-461f-8297-fcc5f68edb82 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.487071 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ad03-1c04-461f-8297-fcc5f68edb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.517241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7637ad03-1c04-461f-8297-fcc5f68edb82 None None] MFA Rules not processed for user `58158e73b41d47f79890a415fec2c95f`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:54.518620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7637ad03-1c04-461f-8297-fcc5f68edb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:54.592221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1184/2366] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:54.596741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28ba5-8c83-4f58-9d8b-25509f8a059f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.669698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee28ba5-8c83-4f58-9d8b-25509f8a059f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.674510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4d5a-b728-4ebe-a3b3-619be54ec075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.675122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4d5a-b728-4ebe-a3b3-619be54ec075 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.675408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4d5a-b728-4ebe-a3b3-619be54ec075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.675693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4d5a-b728-4ebe-a3b3-619be54ec075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.676349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f4d5a-b728-4ebe-a3b3-619be54ec075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.678310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f4d5a-b728-4ebe-a3b3-619be54ec075 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.715617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1183/2367] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:41:54 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:41:54.716311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637ad03-1c04-461f-8297-fcc5f68edb82 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.726930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637ad03-1c04-461f-8297-fcc5f68edb82 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.796928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f13fe1-111d-4373-94eb-bec470112903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.797750 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f13fe1-111d-4373-94eb-bec470112903 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.798127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f13fe1-111d-4373-94eb-bec470112903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.798634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f13fe1-111d-4373-94eb-bec470112903 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.799370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f13fe1-111d-4373-94eb-bec470112903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.801667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f13fe1-111d-4373-94eb-bec470112903 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.829462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1185/2368] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:41:54 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:41:54.833409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4d5a-b728-4ebe-a3b3-619be54ec075 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.848317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4d5a-b728-4ebe-a3b3-619be54ec075 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.853414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b85220-bca9-4f7f-aeef-26cb6423d470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.854087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85220-bca9-4f7f-aeef-26cb6423d470 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.854356 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85220-bca9-4f7f-aeef-26cb6423d470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.854637 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85220-bca9-4f7f-aeef-26cb6423d470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.855335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b85220-bca9-4f7f-aeef-26cb6423d470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.857005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b85220-bca9-4f7f-aeef-26cb6423d470 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.868605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1184/2369] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:54.877845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f13fe1-111d-4373-94eb-bec470112903 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.883842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f13fe1-111d-4373-94eb-bec470112903 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:54.888800 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc737534-0352-4dee-ba75-375b3d10ba0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:54.889464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc737534-0352-4dee-ba75-375b3d10ba0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:54.889793 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc737534-0352-4dee-ba75-375b3d10ba0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:54.890088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc737534-0352-4dee-ba75-375b3d10ba0a admin admin] PATH_INFO: `/v3/projects/76640e1f6b2e48b0ae21948bde2e12d0/users/4d8bf161172b445fbf1ddaaf67f06138/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:54.916968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc737534-0352-4dee-ba75-375b3d10ba0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76640e1f6b2e48b0ae21948bde2e12d0, user_id=4d8bf161172b445fbf1ddaaf67f06138, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:54.922718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc737534-0352-4dee-ba75-375b3d10ba0a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:54.959799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1186/2370] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:54 2022] PUT /identity/v3/projects/76640e1f6b2e48b0ae21948bde2e12d0/users/4d8bf161172b445fbf1ddaaf67f06138/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:54.964591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b85220-bca9-4f7f-aeef-26cb6423d470 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:54.979161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b85220-bca9-4f7f-aeef-26cb6423d470 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:55.042809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669daa-f92a-49d3-a146-695efb801747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:55.043461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669daa-f92a-49d3-a146-695efb801747 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:55.043763 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669daa-f92a-49d3-a146-695efb801747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:55.044041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669daa-f92a-49d3-a146-695efb801747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:55.044935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f669daa-f92a-49d3-a146-695efb801747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:55.046630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f669daa-f92a-49d3-a146-695efb801747 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:55.054590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:55.063979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1185/2371] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:41:55.065156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc737534-0352-4dee-ba75-375b3d10ba0a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:55.077781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc737534-0352-4dee-ba75-375b3d10ba0a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:55.092046 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:55.092749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:55.093028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:55.093301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] PATH_INFO: `/v3/projects/76640e1f6b2e48b0ae21948bde2e12d0/users/4d8bf161172b445fbf1ddaaf67f06138/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:55.099093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] RBAC: Authorizing `identity:create_grant(project_id=76640e1f6b2e48b0ae21948bde2e12d0, user_id=4d8bf161172b445fbf1ddaaf67f06138, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:55.101832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:55.113385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1187/2372] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:41:55 2022] PUT /identity/v3/projects/76640e1f6b2e48b0ae21948bde2e12d0/users/4d8bf161172b445fbf1ddaaf67f06138/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:41:55.125824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023f912-b42f-48ec-bed1-c378f13608f4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:55.126110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023f912-b42f-48ec-bed1-c378f13608f4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:55.126387 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023f912-b42f-48ec-bed1-c378f13608f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:55.155550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5023f912-b42f-48ec-bed1-c378f13608f4 None None] MFA Rules not processed for user `4d8bf161172b445fbf1ddaaf67f06138`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:41:55.157053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5023f912-b42f-48ec-bed1-c378f13608f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:55.256957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1186/2373] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:41:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:41:55.269984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:55.271907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:55.286433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:41:55.333398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4393ab-031d-4e74-a7bb-f91ce26e08da admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:55.337142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da384a64-93d3-488f-b6eb-7faea5defcf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:55.337796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da384a64-93d3-488f-b6eb-7faea5defcf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:55.338080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da384a64-93d3-488f-b6eb-7faea5defcf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:55.338364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da384a64-93d3-488f-b6eb-7faea5defcf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:55.347982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da384a64-93d3-488f-b6eb-7faea5defcf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:55.350216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da384a64-93d3-488f-b6eb-7faea5defcf7 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:55.367781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1188/2374] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:41:55.455598 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023f912-b42f-48ec-bed1-c378f13608f4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:41:55.457650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5023f912-b42f-48ec-bed1-c378f13608f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:41:55.473718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023f912-b42f-48ec-bed1-c378f13608f4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:41:55.478526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c3a99-5fcc-42d4-ac7f-49c18c12be36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:41:55.479148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3a99-5fcc-42d4-ac7f-49c18c12be36 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:41:55.479431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3a99-5fcc-42d4-ac7f-49c18c12be36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:41:55.479708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c3a99-5fcc-42d4-ac7f-49c18c12be36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:41:55.544033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c3a99-5fcc-42d4-ac7f-49c18c12be36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:41:55.545498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c3a99-5fcc-42d4-ac7f-49c18c12be36 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:41:55.555696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1187/2375] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:00.371878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da384a64-93d3-488f-b6eb-7faea5defcf7 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:00.433859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da384a64-93d3-488f-b6eb-7faea5defcf7 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:00.439854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:00.440598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:00.440887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:00.441163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] PATH_INFO: `/v3/users/58158e73b41d47f79890a415fec2c95f` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:00.442337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58158e73b41d47f79890a415fec2c95f)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:00.444265 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:00.494639 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58158e73b41d47f79890a415fec2c95f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:00.495211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58158e73b41d47f79890a415fec2c95f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:00.503951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58158e73b41d47f79890a415fec2c95f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:00.504590 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58158e73b41d47f79890a415fec2c95f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:00.514112 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58158e73b41d47f79890a415fec2c95f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:00.538709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1189/2376] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:42:00 2022] DELETE /identity/v3/users/58158e73b41d47f79890a415fec2c95f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:42:00.540804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a8a-5d4d-4469-acdb-b28d130b76f6 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:00.541314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a8a-5d4d-4469-acdb-b28d130b76f6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:00.541412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a8a-5d4d-4469-acdb-b28d130b76f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:00.571684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a87f6a8a-5d4d-4469-acdb-b28d130b76f6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:00.572968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a87f6a8a-5d4d-4469-acdb-b28d130b76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:00.652236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1188/2377] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:00.663163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:00.664987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:00.723485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:00.767601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7736803-4a2e-4b29-b6df-d94db952afd9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:00.772415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a31a88-bd83-4586-88d8-eea78b9a780b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:00.773174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31a88-bd83-4586-88d8-eea78b9a780b service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:00.773561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31a88-bd83-4586-88d8-eea78b9a780b service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:00.773913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31a88-bd83-4586-88d8-eea78b9a780b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:00.786294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a31a88-bd83-4586-88d8-eea78b9a780b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:00.788157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a31a88-bd83-4586-88d8-eea78b9a780b service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:00.800907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1190/2378] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:01.561813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6a8a-5d4d-4469-acdb-b28d130b76f6 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:01.563424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a87f6a8a-5d4d-4469-acdb-b28d130b76f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:01.580775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6a8a-5d4d-4469-acdb-b28d130b76f6 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:01.585481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:01.586152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:01.586596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:01.587017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] PATH_INFO: `/v3/projects/8279e86246654a52b0967bf5ac812b68` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:01.588316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8279e86246654a52b0967bf5ac812b68)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:01.590424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:01.608617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:01.645132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8279e86246654a52b0967bf5ac812b68', 'request_id': 'req-4a5a6803-2b22-43bb-a4a2-599bf795b935'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.653444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8279e86246654a52b0967bf5ac812b68', 'request_id': 'req-4a5a6803-2b22-43bb-a4a2-599bf795b935'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.660810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8279e86246654a52b0967bf5ac812b68', 'request_id': 'req-4a5a6803-2b22-43bb-a4a2-599bf795b935'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.673118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] The token cache is being invalidate because project 8279e86246654a52b0967bf5ac812b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:42:01.673414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.674128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.675631 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1189/2379] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:42:01 2022] DELETE /identity/v3/projects/8279e86246654a52b0967bf5ac812b68 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:01.679869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a31a88-bd83-4586-88d8-eea78b9a780b service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:01.689975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a31a88-bd83-4586-88d8-eea78b9a780b service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:01.750016 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:01.750664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:01.750949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:01.751229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] PATH_INFO: `/v3/users/4d8bf161172b445fbf1ddaaf67f06138` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:01.752373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8bf161172b445fbf1ddaaf67f06138)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:01.754340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:01.806529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8bf161172b445fbf1ddaaf67f06138'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.807202 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8bf161172b445fbf1ddaaf67f06138'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.814169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8bf161172b445fbf1ddaaf67f06138'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.814807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8bf161172b445fbf1ddaaf67f06138'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.822611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ec5d12f2-9d44-449b-b723-507299c26c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8bf161172b445fbf1ddaaf67f06138'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:01.841780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1191/2380] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:42:01 2022] DELETE /identity/v3/users/4d8bf161172b445fbf1ddaaf67f06138 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:02.134269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:02.136109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:02.151794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a6803-2b22-43bb-a4a2-599bf795b935 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:02.215457 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:02.216194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.216363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.216690 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] PATH_INFO: `/v3/projects/76640e1f6b2e48b0ae21948bde2e12d0` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.217998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76640e1f6b2e48b0ae21948bde2e12d0)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:02.220123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:02.275380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76640e1f6b2e48b0ae21948bde2e12d0', 'request_id': 'req-41c83164-c58d-4909-a3c3-675c89a07a6e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:02.285207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76640e1f6b2e48b0ae21948bde2e12d0', 'request_id': 'req-41c83164-c58d-4909-a3c3-675c89a07a6e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:02.292525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76640e1f6b2e48b0ae21948bde2e12d0', 'request_id': 'req-41c83164-c58d-4909-a3c3-675c89a07a6e'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:02.303964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] The token cache is being invalidate because project 76640e1f6b2e48b0ae21948bde2e12d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:42:02.304260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:02.306153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-41c83164-c58d-4909-a3c3-675c89a07a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:02.309700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1190/2381] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:42:02 2022] DELETE /identity/v3/projects/76640e1f6b2e48b0ae21948bde2e12d0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:02.311969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8858e-65ba-40cd-836e-c91fdd340c74 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.312656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8858e-65ba-40cd-836e-c91fdd340c74 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.313252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8858e-65ba-40cd-836e-c91fdd340c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.335749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6cb8858e-65ba-40cd-836e-c91fdd340c74 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:02.337345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6cb8858e-65ba-40cd-836e-c91fdd340c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:02.395743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:02.410316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1192/2382] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:02.418147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22a85-b8e8-4487-803c-bf8f31f0d0b0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.418440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22a85-b8e8-4487-803c-bf8f31f0d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.418724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22a85-b8e8-4487-803c-bf8f31f0d0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.439551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-efc22a85-b8e8-4487-803c-bf8f31f0d0b0 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:02.440777 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-efc22a85-b8e8-4487-803c-bf8f31f0d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:02.449563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1191/2383] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:02.454127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8858e-65ba-40cd-836e-c91fdd340c74 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:02.466771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8858e-65ba-40cd-836e-c91fdd340c74 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:02.471522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:02.472135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.472419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.472698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.473382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:42:02.473728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:02.475356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:02.487674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1193/2384] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:42:02.492439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22a85-b8e8-4487-803c-bf8f31f0d0b0 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:02.501796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22a85-b8e8-4487-803c-bf8f31f0d0b0 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:02.507181 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631fd53-534d-4a80-9f29-b2f3da49e787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:02.507785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631fd53-534d-4a80-9f29-b2f3da49e787 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.508069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631fd53-534d-4a80-9f29-b2f3da49e787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.508344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631fd53-534d-4a80-9f29-b2f3da49e787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.508988 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631fd53-534d-4a80-9f29-b2f3da49e787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:02.511314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631fd53-534d-4a80-9f29-b2f3da49e787 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:02.545052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1192/2385] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:42:02 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:02.549596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:02.560834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fd752-f458-4222-91cf-f931e4eae982 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:02.618863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c10fc-0f38-4442-b761-1c2e1ca92a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:02.619499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c10fc-0f38-4442-b761-1c2e1ca92a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.619765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c10fc-0f38-4442-b761-1c2e1ca92a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.620044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c10fc-0f38-4442-b761-1c2e1ca92a1d admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.620675 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c10fc-0f38-4442-b761-1c2e1ca92a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:02.622723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c10fc-0f38-4442-b761-1c2e1ca92a1d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:02.646210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1194/2386] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:42:02 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:02.650388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631fd53-534d-4a80-9f29-b2f3da49e787 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:02.657311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:02.661541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631fd53-534d-4a80-9f29-b2f3da49e787 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:02.667894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df098e-4ca8-45a7-87b5-4eaa161f449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:02.668686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df098e-4ca8-45a7-87b5-4eaa161f449a admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.669036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df098e-4ca8-45a7-87b5-4eaa161f449a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.669536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df098e-4ca8-45a7-87b5-4eaa161f449a admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.670259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df098e-4ca8-45a7-87b5-4eaa161f449a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:02.672052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df098e-4ca8-45a7-87b5-4eaa161f449a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:02.684604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1193/2387] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:02.686688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c10fc-0f38-4442-b761-1c2e1ca92a1d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:02.697459 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c10fc-0f38-4442-b761-1c2e1ca92a1d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:02.702689 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4bb8a-7e7d-4849-9533-cb0c6b226820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:02.703303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4bb8a-7e7d-4849-9533-cb0c6b226820 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.703586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4bb8a-7e7d-4849-9533-cb0c6b226820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.703865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4bb8a-7e7d-4849-9533-cb0c6b226820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.704514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4bb8a-7e7d-4849-9533-cb0c6b226820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:02.706400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4bb8a-7e7d-4849-9533-cb0c6b226820 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:02.718624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1195/2388] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:02.722581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df098e-4ca8-45a7-87b5-4eaa161f449a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:02.733032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df098e-4ca8-45a7-87b5-4eaa161f449a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:02.737914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb129-3a2a-4e44-a395-d4f178f48b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:02.738571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb129-3a2a-4e44-a395-d4f178f48b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.738857 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb129-3a2a-4e44-a395-d4f178f48b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.739137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb129-3a2a-4e44-a395-d4f178f48b3f admin admin] PATH_INFO: `/v3/projects/3d619333bd3844acaff06927bbc518f4/users/fc091edb236a4e5ebc1ad5ff4a7cfbbc/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.754947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdb129-3a2a-4e44-a395-d4f178f48b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d619333bd3844acaff06927bbc518f4, user_id=fc091edb236a4e5ebc1ad5ff4a7cfbbc, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:02.758280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdb129-3a2a-4e44-a395-d4f178f48b3f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:02.772154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1194/2389] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:42:02 2022] PUT /identity/v3/projects/3d619333bd3844acaff06927bbc518f4/users/fc091edb236a4e5ebc1ad5ff4a7cfbbc/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:02.783592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ba72-b7dc-42cf-bc1d-54b07cdcedc5 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.783885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ba72-b7dc-42cf-bc1d-54b07cdcedc5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.784208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ba72-b7dc-42cf-bc1d-54b07cdcedc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.814464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8768ba72-b7dc-42cf-bc1d-54b07cdcedc5 None None] MFA Rules not processed for user `fc091edb236a4e5ebc1ad5ff4a7cfbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:02.815685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8768ba72-b7dc-42cf-bc1d-54b07cdcedc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:02.881388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1196/2390] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:02.886183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb129-3a2a-4e44-a395-d4f178f48b3f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:02.959281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb129-3a2a-4e44-a395-d4f178f48b3f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:02.964207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851dad1-e202-449e-b9fe-f98ea2736a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:02.964817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851dad1-e202-449e-b9fe-f98ea2736a53 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:02.965104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851dad1-e202-449e-b9fe-f98ea2736a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:02.965385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851dad1-e202-449e-b9fe-f98ea2736a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:02.966096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851dad1-e202-449e-b9fe-f98ea2736a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:02.968028 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851dad1-e202-449e-b9fe-f98ea2736a53 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:02.995171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1195/2391] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:42:02 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:02.999529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768ba72-b7dc-42cf-bc1d-54b07cdcedc5 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:03.010920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768ba72-b7dc-42cf-bc1d-54b07cdcedc5 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:03.063754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:03.074832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00953d-94b5-49a7-88da-679341161678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:03.075471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00953d-94b5-49a7-88da-679341161678 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:03.075761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00953d-94b5-49a7-88da-679341161678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:03.076033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00953d-94b5-49a7-88da-679341161678 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:03.076681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00953d-94b5-49a7-88da-679341161678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:03.078743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00953d-94b5-49a7-88da-679341161678 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:03.102446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1197/2392] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:42:02 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:03.106519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851dad1-e202-449e-b9fe-f98ea2736a53 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:03.117720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851dad1-e202-449e-b9fe-f98ea2736a53 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:03.123370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435e90-348f-4d26-af8c-58bf56af5e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:03.124137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435e90-348f-4d26-af8c-58bf56af5e74 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:03.124961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435e90-348f-4d26-af8c-58bf56af5e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:03.124961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2435e90-348f-4d26-af8c-58bf56af5e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:03.125687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2435e90-348f-4d26-af8c-58bf56af5e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:03.127466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2435e90-348f-4d26-af8c-58bf56af5e74 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:03.143444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1196/2393] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:03.144956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00953d-94b5-49a7-88da-679341161678 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:03.156166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00953d-94b5-49a7-88da-679341161678 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:03.161372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb08f-9cc1-4771-a885-9f8677341404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:03.162741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb08f-9cc1-4771-a885-9f8677341404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:03.163030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb08f-9cc1-4771-a885-9f8677341404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:03.163312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb08f-9cc1-4771-a885-9f8677341404 admin admin] PATH_INFO: `/v3/projects/731c43e416134d9e87cf1504757faa42/users/9c4075c88ee44b999a420f2a470374ed/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:03.179915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eb08f-9cc1-4771-a885-9f8677341404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731c43e416134d9e87cf1504757faa42, user_id=9c4075c88ee44b999a420f2a470374ed, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:03.183073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eb08f-9cc1-4771-a885-9f8677341404 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:03.197875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1198/2394] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:42:03 2022] PUT /identity/v3/projects/731c43e416134d9e87cf1504757faa42/users/9c4075c88ee44b999a420f2a470374ed/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:03.201911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435e90-348f-4d26-af8c-58bf56af5e74 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:03.213230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2435e90-348f-4d26-af8c-58bf56af5e74 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:03.306446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143d788-4147-4d04-a164-382034c9b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:03.307077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d788-4147-4d04-a164-382034c9b1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:03.307365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d788-4147-4d04-a164-382034c9b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:03.307642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143d788-4147-4d04-a164-382034c9b1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:03.308290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143d788-4147-4d04-a164-382034c9b1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:03.309996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143d788-4147-4d04-a164-382034c9b1a7 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:03.320582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1197/2395] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:03.324485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb08f-9cc1-4771-a885-9f8677341404 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:03.336790 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb08f-9cc1-4771-a885-9f8677341404 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:03.341987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:03.342676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:03.342957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:03.343234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] PATH_INFO: `/v3/projects/731c43e416134d9e87cf1504757faa42/users/9c4075c88ee44b999a420f2a470374ed/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:03.345179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] RBAC: Authorizing `identity:create_grant(project_id=731c43e416134d9e87cf1504757faa42, user_id=9c4075c88ee44b999a420f2a470374ed, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:03.347896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:03.360866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1199/2396] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:42:03 2022] PUT /identity/v3/projects/731c43e416134d9e87cf1504757faa42/users/9c4075c88ee44b999a420f2a470374ed/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:03.370992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a8291-e8ca-420e-99bb-40d9bae27d05 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:03.371280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a8291-e8ca-420e-99bb-40d9bae27d05 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:03.371595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a8291-e8ca-420e-99bb-40d9bae27d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:03.405059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-511a8291-e8ca-420e-99bb-40d9bae27d05 None None] MFA Rules not processed for user `9c4075c88ee44b999a420f2a470374ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:03.406464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-511a8291-e8ca-420e-99bb-40d9bae27d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:03.592113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:03.644272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1198/2397] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:03.657653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:03.659992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:03.730653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4ec99-b88a-4abc-8ef9-feb469db959b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:03.734510 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d419ff3-590e-4068-a4d4-1c788dda5a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:03.735113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d419ff3-590e-4068-a4d4-1c788dda5a04 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:03.735382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d419ff3-590e-4068-a4d4-1c788dda5a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:03.735653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d419ff3-590e-4068-a4d4-1c788dda5a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:03.745645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d419ff3-590e-4068-a4d4-1c788dda5a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:03.747091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d419ff3-590e-4068-a4d4-1c788dda5a04 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:03.759237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1200/2398] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:42:03.841956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a8291-e8ca-420e-99bb-40d9bae27d05 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:03.853987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a8291-e8ca-420e-99bb-40d9bae27d05 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:03.858765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc361b8b-0e8d-47c0-88a8-ef585f0393d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:03.864253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc361b8b-0e8d-47c0-88a8-ef585f0393d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:03.864253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc361b8b-0e8d-47c0-88a8-ef585f0393d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:03.864253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc361b8b-0e8d-47c0-88a8-ef585f0393d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:03.944563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc361b8b-0e8d-47c0-88a8-ef585f0393d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:03.946304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc361b8b-0e8d-47c0-88a8-ef585f0393d9 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:03.958048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1199/2399] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:04.302019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d419ff3-590e-4068-a4d4-1c788dda5a04 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:04.369165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d419ff3-590e-4068-a4d4-1c788dda5a04 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:04.373932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:04.374609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:04.374890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:04.375167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] PATH_INFO: `/v3/users/fc091edb236a4e5ebc1ad5ff4a7cfbbc` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:04.376311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc091edb236a4e5ebc1ad5ff4a7cfbbc)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:04.378276 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:04.430142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc091edb236a4e5ebc1ad5ff4a7cfbbc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:04.430803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc091edb236a4e5ebc1ad5ff4a7cfbbc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:04.432078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:04.441161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc091edb236a4e5ebc1ad5ff4a7cfbbc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:04.442106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc091edb236a4e5ebc1ad5ff4a7cfbbc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:04.449792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc091edb236a4e5ebc1ad5ff4a7cfbbc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:04.467290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1201/2400] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:42:04 2022] DELETE /identity/v3/users/fc091edb236a4e5ebc1ad5ff4a7cfbbc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:04.471924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378be17-b7c7-47ea-ad7a-7ab77a1b3baf None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:04.472210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378be17-b7c7-47ea-ad7a-7ab77a1b3baf None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:04.472491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378be17-b7c7-47ea-ad7a-7ab77a1b3baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:04.492184 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-a378be17-b7c7-47ea-ad7a-7ab77a1b3baf None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:04.493391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a378be17-b7c7-47ea-ad7a-7ab77a1b3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:04.554416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1200/2401] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:04.564397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:04.566158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:04.627347 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b287a0-b6f2-40ae-b0cc-7a69fcae896a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:04.631390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63416619-57fa-47bb-9823-2733adc2a0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:04.632025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63416619-57fa-47bb-9823-2733adc2a0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:04.632307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63416619-57fa-47bb-9823-2733adc2a0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:04.632583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63416619-57fa-47bb-9823-2733adc2a0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:04.643782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63416619-57fa-47bb-9823-2733adc2a0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:04.645245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63416619-57fa-47bb-9823-2733adc2a0a3 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:04.656414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1202/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:05.051502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378be17-b7c7-47ea-ad7a-7ab77a1b3baf None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:05.053132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a378be17-b7c7-47ea-ad7a-7ab77a1b3baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:05.069686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378be17-b7c7-47ea-ad7a-7ab77a1b3baf None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:05.075921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:05.076594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:05.076875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:05.077482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] PATH_INFO: `/v3/projects/3d619333bd3844acaff06927bbc518f4` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:05.078558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d619333bd3844acaff06927bbc518f4)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:05.080562 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:05.155080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d619333bd3844acaff06927bbc518f4', 'request_id': 'req-3653e94a-efed-45bf-a494-753ddf0c84ac'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.166059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d619333bd3844acaff06927bbc518f4', 'request_id': 'req-3653e94a-efed-45bf-a494-753ddf0c84ac'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.172038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:05.181369 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d619333bd3844acaff06927bbc518f4', 'request_id': 'req-3653e94a-efed-45bf-a494-753ddf0c84ac'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.202823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] The token cache is being invalidate because project 3d619333bd3844acaff06927bbc518f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:42:05.203145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.204236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.207345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1201/2403] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:42:05 2022] DELETE /identity/v3/projects/3d619333bd3844acaff06927bbc518f4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:42:05.211819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63416619-57fa-47bb-9823-2733adc2a0a3 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:05.232908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63416619-57fa-47bb-9823-2733adc2a0a3 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:05.307417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:05.308551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:05.309143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:05.309789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] PATH_INFO: `/v3/users/9c4075c88ee44b999a420f2a470374ed` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:05.312286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4075c88ee44b999a420f2a470374ed)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:05.316355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:05.422285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4075c88ee44b999a420f2a470374ed'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.423301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4075c88ee44b999a420f2a470374ed'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.439584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4075c88ee44b999a420f2a470374ed'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.443093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4075c88ee44b999a420f2a470374ed'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.462160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9b66e5bf-bcf9-429e-83f7-a9f311b1df51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4075c88ee44b999a420f2a470374ed'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:05.475366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:05.498318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1203/2404] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:42:05 2022] DELETE /identity/v3/users/9c4075c88ee44b999a420f2a470374ed => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:05.832025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:05.833484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:05.861003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e94a-efed-45bf-a494-753ddf0c84ac admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:05.931519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:05.932063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:05.932346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:05.932676 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] PATH_INFO: `/v3/projects/731c43e416134d9e87cf1504757faa42` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:05.933989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=731c43e416134d9e87cf1504757faa42)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:05.936177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.000308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731c43e416134d9e87cf1504757faa42', 'request_id': 'req-c9d1588e-2837-4eff-82a7-3b724bf45abb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:06.010197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731c43e416134d9e87cf1504757faa42', 'request_id': 'req-c9d1588e-2837-4eff-82a7-3b724bf45abb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:06.018698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731c43e416134d9e87cf1504757faa42', 'request_id': 'req-c9d1588e-2837-4eff-82a7-3b724bf45abb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:06.032366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] The token cache is being invalidate because project 731c43e416134d9e87cf1504757faa42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:42:06.032664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:06.033611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c9d1588e-2837-4eff-82a7-3b724bf45abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:06.035740 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1202/2405] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:42:05 2022] DELETE /identity/v3/projects/731c43e416134d9e87cf1504757faa42 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:06.041059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67302a-585e-4bf7-aaa5-6d315927889b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.041424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67302a-585e-4bf7-aaa5-6d315927889b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.041738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67302a-585e-4bf7-aaa5-6d315927889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.064231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-3b67302a-585e-4bf7-aaa5-6d315927889b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:06.065497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3b67302a-585e-4bf7-aaa5-6d315927889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:06.138834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1204/2406] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:06.150552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca36cc-85eb-44a0-90b8-0249bfcae93b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.151091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca36cc-85eb-44a0-90b8-0249bfcae93b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.151091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca36cc-85eb-44a0-90b8-0249bfcae93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.176008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-33ca36cc-85eb-44a0-90b8-0249bfcae93b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:06.177322 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-33ca36cc-85eb-44a0-90b8-0249bfcae93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:06.186985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1203/2407] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:06.191664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67302a-585e-4bf7-aaa5-6d315927889b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.205035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67302a-585e-4bf7-aaa5-6d315927889b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.212062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.212990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.213474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.214088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.215224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:42:06.215666 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:06.217571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.231942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1205/2408] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:42:06.237185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca36cc-85eb-44a0-90b8-0249bfcae93b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.250268 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca36cc-85eb-44a0-90b8-0249bfcae93b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.256365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab893123-bcc4-415d-bf49-94d35fa18759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.257053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab893123-bcc4-415d-bf49-94d35fa18759 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.257405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab893123-bcc4-415d-bf49-94d35fa18759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.257711 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab893123-bcc4-415d-bf49-94d35fa18759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.258348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab893123-bcc4-415d-bf49-94d35fa18759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:06.260587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab893123-bcc4-415d-bf49-94d35fa18759 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.290587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1204/2409] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:42:06 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:06.295506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.307859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915496fa-3207-475d-af0e-bd2d5dfc79a6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.375790 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05048e-e3a0-41d3-b3a6-bc06d5ef9ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.376441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05048e-e3a0-41d3-b3a6-bc06d5ef9ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.376764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05048e-e3a0-41d3-b3a6-bc06d5ef9ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.377007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05048e-e3a0-41d3-b3a6-bc06d5ef9ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.377722 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05048e-e3a0-41d3-b3a6-bc06d5ef9ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:06.379759 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05048e-e3a0-41d3-b3a6-bc06d5ef9ae4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.405551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1206/2410] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:42:06 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:06.409562 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab893123-bcc4-415d-bf49-94d35fa18759 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.421155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab893123-bcc4-415d-bf49-94d35fa18759 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.426285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b44d-33db-4d81-8a0a-1094de201412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.427071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b44d-33db-4d81-8a0a-1094de201412 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.427356 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b44d-33db-4d81-8a0a-1094de201412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.428166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b44d-33db-4d81-8a0a-1094de201412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.428815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419b44d-33db-4d81-8a0a-1094de201412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:06.430533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419b44d-33db-4d81-8a0a-1094de201412 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.441636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1205/2411] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:06.446616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05048e-e3a0-41d3-b3a6-bc06d5ef9ae4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.462913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05048e-e3a0-41d3-b3a6-bc06d5ef9ae4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.470118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945db028-b8a1-4294-be57-65545b32389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.470882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db028-b8a1-4294-be57-65545b32389f admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.471248 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db028-b8a1-4294-be57-65545b32389f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.471588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945db028-b8a1-4294-be57-65545b32389f admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.472354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db028-b8a1-4294-be57-65545b32389f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:06.474318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945db028-b8a1-4294-be57-65545b32389f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.495598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1207/2412] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:06.504633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b44d-33db-4d81-8a0a-1094de201412 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.517018 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b44d-33db-4d81-8a0a-1094de201412 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.521957 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288395-d43f-4ca5-977d-5508ad750c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.522580 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288395-d43f-4ca5-977d-5508ad750c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.522863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288395-d43f-4ca5-977d-5508ad750c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.523144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288395-d43f-4ca5-977d-5508ad750c9b admin admin] PATH_INFO: `/v3/projects/2aec60b991734412b570a0f5049c01ce/users/f6bfeedb5cf642e6b88159b6e6982bb0/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.541384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3288395-d43f-4ca5-977d-5508ad750c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aec60b991734412b570a0f5049c01ce, user_id=f6bfeedb5cf642e6b88159b6e6982bb0, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:06.544741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3288395-d43f-4ca5-977d-5508ad750c9b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.562540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1206/2413] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:42:06 2022] PUT /identity/v3/projects/2aec60b991734412b570a0f5049c01ce/users/f6bfeedb5cf642e6b88159b6e6982bb0/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:06.574671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4055920-ee61-483a-8d68-0071e371385f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.575423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4055920-ee61-483a-8d68-0071e371385f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.575423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4055920-ee61-483a-8d68-0071e371385f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.608243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d4055920-ee61-483a-8d68-0071e371385f None None] MFA Rules not processed for user `f6bfeedb5cf642e6b88159b6e6982bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:06.609928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d4055920-ee61-483a-8d68-0071e371385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:06.665041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:06.692806 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1208/2414] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:06.703705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288395-d43f-4ca5-977d-5508ad750c9b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.718186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:06.783164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288395-d43f-4ca5-977d-5508ad750c9b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.789893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc03c4f-fb0c-4ed2-8e4c-4158400ed048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.790668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03c4f-fb0c-4ed2-8e4c-4158400ed048 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.790916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03c4f-fb0c-4ed2-8e4c-4158400ed048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.791187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc03c4f-fb0c-4ed2-8e4c-4158400ed048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.792149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc03c4f-fb0c-4ed2-8e4c-4158400ed048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:06.794701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc03c4f-fb0c-4ed2-8e4c-4158400ed048 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.841629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1207/2415] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:42:06 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:06.846857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4055920-ee61-483a-8d68-0071e371385f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.860065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4055920-ee61-483a-8d68-0071e371385f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.940515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47c74e-510e-4c9c-8904-6ee8a2d13f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.940515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47c74e-510e-4c9c-8904-6ee8a2d13f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.940816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47c74e-510e-4c9c-8904-6ee8a2d13f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.941059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47c74e-510e-4c9c-8904-6ee8a2d13f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:06.941763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47c74e-510e-4c9c-8904-6ee8a2d13f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:06.944133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47c74e-510e-4c9c-8904-6ee8a2d13f84 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:06.970831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1209/2416] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:42:06 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:06.977701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc03c4f-fb0c-4ed2-8e4c-4158400ed048 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:06.991803 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc03c4f-fb0c-4ed2-8e4c-4158400ed048 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:06.997755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639f66-40b6-4cbd-8cfe-feeaf05725cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:06.998756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639f66-40b6-4cbd-8cfe-feeaf05725cd admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:06.999061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639f66-40b6-4cbd-8cfe-feeaf05725cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:06.999680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639f66-40b6-4cbd-8cfe-feeaf05725cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:07.000543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c639f66-40b6-4cbd-8cfe-feeaf05725cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:07.002528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c639f66-40b6-4cbd-8cfe-feeaf05725cd admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:07.020940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1208/2417] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:07.022699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47c74e-510e-4c9c-8904-6ee8a2d13f84 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:07.033401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47c74e-510e-4c9c-8904-6ee8a2d13f84 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:07.038947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d293aa-e5cd-4e91-99dd-a8724909714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:07.039673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d293aa-e5cd-4e91-99dd-a8724909714d admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:07.039957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d293aa-e5cd-4e91-99dd-a8724909714d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:07.040234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d293aa-e5cd-4e91-99dd-a8724909714d admin admin] PATH_INFO: `/v3/projects/9be746b1694a4bc88f24eb295ea612c1/users/c235c02eba1b45e3bcc1244ceaab7843/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:07.063223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d293aa-e5cd-4e91-99dd-a8724909714d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be746b1694a4bc88f24eb295ea612c1, user_id=c235c02eba1b45e3bcc1244ceaab7843, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:07.066776 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d293aa-e5cd-4e91-99dd-a8724909714d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:07.089647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1210/2418] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:42:07 2022] PUT /identity/v3/projects/9be746b1694a4bc88f24eb295ea612c1/users/c235c02eba1b45e3bcc1244ceaab7843/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:07.098660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639f66-40b6-4cbd-8cfe-feeaf05725cd admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:07.113219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639f66-40b6-4cbd-8cfe-feeaf05725cd admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:07.191335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d3bc-043a-4458-ae3f-fe7f05911233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:07.192163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d3bc-043a-4458-ae3f-fe7f05911233 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:07.192577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d3bc-043a-4458-ae3f-fe7f05911233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:07.192874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d3bc-043a-4458-ae3f-fe7f05911233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:07.193868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4d3bc-043a-4458-ae3f-fe7f05911233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:07.195806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4d3bc-043a-4458-ae3f-fe7f05911233 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:07.211452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1209/2419] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:07.212294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d293aa-e5cd-4e91-99dd-a8724909714d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:07.231470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d293aa-e5cd-4e91-99dd-a8724909714d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:07.244651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:07.245641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:07.245776 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:07.246043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] PATH_INFO: `/v3/projects/9be746b1694a4bc88f24eb295ea612c1/users/c235c02eba1b45e3bcc1244ceaab7843/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:07.252830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be746b1694a4bc88f24eb295ea612c1, user_id=c235c02eba1b45e3bcc1244ceaab7843, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:07.262164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:07.285305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1211/2420] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:42:07 2022] PUT /identity/v3/projects/9be746b1694a4bc88f24eb295ea612c1/users/c235c02eba1b45e3bcc1244ceaab7843/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:42:07.296179 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888af5-4f96-49fe-b11c-96b14891f7e0 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:07.296458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888af5-4f96-49fe-b11c-96b14891f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:07.296734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62888af5-4f96-49fe-b11c-96b14891f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:07.340090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-62888af5-4f96-49fe-b11c-96b14891f7e0 None None] MFA Rules not processed for user `c235c02eba1b45e3bcc1244ceaab7843`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:07.341317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-62888af5-4f96-49fe-b11c-96b14891f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:07.441782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1210/2421] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:07.515786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:07.517590 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:07.602000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ed927-70f5-44fe-81a5-86239aa4b4f8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:07.606808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc0e3f-96da-4f4e-9992-404dd36a4d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:07.607481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0e3f-96da-4f4e-9992-404dd36a4d4a service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:07.607725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0e3f-96da-4f4e-9992-404dd36a4d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:07.607995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc0e3f-96da-4f4e-9992-404dd36a4d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:07.667421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:07.681008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc0e3f-96da-4f4e-9992-404dd36a4d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:07.682592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc0e3f-96da-4f4e-9992-404dd36a4d4a service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:07.693289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1212/2422] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:11.479279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62888af5-4f96-49fe-b11c-96b14891f7e0 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:11.480726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-62888af5-4f96-49fe-b11c-96b14891f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:11.492913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:11.561326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62888af5-4f96-49fe-b11c-96b14891f7e0 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:11.566500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4c90d-65f4-4bd3-b470-06bf4b782bc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:11.567123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c90d-65f4-4bd3-b470-06bf4b782bc5 service placement] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:11.567402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c90d-65f4-4bd3-b470-06bf4b782bc5 service placement] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:11.567673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4c90d-65f4-4bd3-b470-06bf4b782bc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:11.570096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-53f4c90d-65f4-4bd3-b470-06bf4b782bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:11.582480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4c90d-65f4-4bd3-b470-06bf4b782bc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:11.584060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4c90d-65f4-4bd3-b470-06bf4b782bc5 service placement] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:11.594752 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1211/2423] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:42:12.301820 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc0e3f-96da-4f4e-9992-404dd36a4d4a service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:12.311224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc0e3f-96da-4f4e-9992-404dd36a4d4a service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:12.315338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d96e6-1a26-42e1-8338-60408e8ad39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:12.316044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d96e6-1a26-42e1-8338-60408e8ad39e service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:12.316393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d96e6-1a26-42e1-8338-60408e8ad39e service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:12.316770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d96e6-1a26-42e1-8338-60408e8ad39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:12.327357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d96e6-1a26-42e1-8338-60408e8ad39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:12.328891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d96e6-1a26-42e1-8338-60408e8ad39e service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:12.339792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1213/2424] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:13.770310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e461f-ed98-48a5-8b24-1141d5fd52d3 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:13.770864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e461f-ed98-48a5-8b24-1141d5fd52d3 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:13.770864 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e461f-ed98-48a5-8b24-1141d5fd52d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:13.802055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-438e461f-ed98-48a5-8b24-1141d5fd52d3 None None] MFA Rules not processed for user `c29ecb6ed0f5439482957c4365aea4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:13.803859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-438e461f-ed98-48a5-8b24-1141d5fd52d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:13.932298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1212/2425] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:18.740417 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d96e6-1a26-42e1-8338-60408e8ad39e service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:18.813264 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d96e6-1a26-42e1-8338-60408e8ad39e service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:18.818207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:18.818958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:18.819266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:18.819552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] PATH_INFO: `/v3/users/f6bfeedb5cf642e6b88159b6e6982bb0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:18.820954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bfeedb5cf642e6b88159b6e6982bb0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:18.822918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:18.894769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bfeedb5cf642e6b88159b6e6982bb0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:18.896148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bfeedb5cf642e6b88159b6e6982bb0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:18.908212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bfeedb5cf642e6b88159b6e6982bb0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:18.909319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bfeedb5cf642e6b88159b6e6982bb0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:18.926239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bfeedb5cf642e6b88159b6e6982bb0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:18.956717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1214/2426] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:42:18 2022] DELETE /identity/v3/users/f6bfeedb5cf642e6b88159b6e6982bb0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:18.964266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be950b64-c223-4cc0-a001-dfcb05ce9a94 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:18.964924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be950b64-c223-4cc0-a001-dfcb05ce9a94 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:18.965882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be950b64-c223-4cc0-a001-dfcb05ce9a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:18.999298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-be950b64-c223-4cc0-a001-dfcb05ce9a94 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:19.001656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-be950b64-c223-4cc0-a001-dfcb05ce9a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:19.087759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1213/2427] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:19.099722 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:19.101778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:19.172840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5622f23-d345-4cda-903a-4e0b282f8c8c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:19.179158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f8aff-8323-4212-afda-b5660c540023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:19.180239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f8aff-8323-4212-afda-b5660c540023 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:19.180747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f8aff-8323-4212-afda-b5660c540023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:19.181243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f8aff-8323-4212-afda-b5660c540023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:19.199366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f8aff-8323-4212-afda-b5660c540023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:19.203451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f8aff-8323-4212-afda-b5660c540023 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:19.212117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:19.224046 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1215/2428] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:42:19.661156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be950b64-c223-4cc0-a001-dfcb05ce9a94 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:19.664499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-be950b64-c223-4cc0-a001-dfcb05ce9a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:19.689407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be950b64-c223-4cc0-a001-dfcb05ce9a94 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:19.696534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:19.697404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:19.697784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:19.701583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] PATH_INFO: `/v3/projects/2aec60b991734412b570a0f5049c01ce` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:19.701583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aec60b991734412b570a0f5049c01ce)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:19.701583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:19.754944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:19.766120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aec60b991734412b570a0f5049c01ce', 'request_id': 'req-d68f9f74-0951-43ab-956c-6b35c73c3aa3'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:19.776914 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aec60b991734412b570a0f5049c01ce', 'request_id': 'req-d68f9f74-0951-43ab-956c-6b35c73c3aa3'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:19.789940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aec60b991734412b570a0f5049c01ce', 'request_id': 'req-d68f9f74-0951-43ab-956c-6b35c73c3aa3'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:19.812100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] The token cache is being invalidate because project 2aec60b991734412b570a0f5049c01ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:42:19.812973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:19.814376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:19.817027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1214/2429] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:42:19 2022] DELETE /identity/v3/projects/2aec60b991734412b570a0f5049c01ce => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:19.821789 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f8aff-8323-4212-afda-b5660c540023 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:19.839565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f8aff-8323-4212-afda-b5660c540023 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:19.950582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:19.952501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:19.952867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:19.954054 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] PATH_INFO: `/v3/users/c235c02eba1b45e3bcc1244ceaab7843` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:19.955325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c235c02eba1b45e3bcc1244ceaab7843)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:19.958229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:20.056025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c235c02eba1b45e3bcc1244ceaab7843'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.056889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c235c02eba1b45e3bcc1244ceaab7843'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.068680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c235c02eba1b45e3bcc1244ceaab7843'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.070604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c235c02eba1b45e3bcc1244ceaab7843'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.083287 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-a6203332-4eae-4c90-bb10-a2b1772e7dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c235c02eba1b45e3bcc1244ceaab7843'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.128333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1216/2430] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:42:19 2022] DELETE /identity/v3/users/c235c02eba1b45e3bcc1244ceaab7843 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:20.641862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:20.643754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:20.668086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f9f74-0951-43ab-956c-6b35c73c3aa3 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:20.816315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:20.817024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:20.817310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:20.817629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] PATH_INFO: `/v3/projects/9be746b1694a4bc88f24eb295ea612c1` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:20.818789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be746b1694a4bc88f24eb295ea612c1)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:20.821271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:20.907045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be746b1694a4bc88f24eb295ea612c1', 'request_id': 'req-0634b5d6-02c1-4555-9c49-329338f8ac12'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.917300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be746b1694a4bc88f24eb295ea612c1', 'request_id': 'req-0634b5d6-02c1-4555-9c49-329338f8ac12'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.926281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be746b1694a4bc88f24eb295ea612c1', 'request_id': 'req-0634b5d6-02c1-4555-9c49-329338f8ac12'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.943519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] The token cache is being invalidate because project 9be746b1694a4bc88f24eb295ea612c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:42:20.943900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.945015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0634b5d6-02c1-4555-9c49-329338f8ac12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:20.946581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1215/2431] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:42:20 2022] DELETE /identity/v3/projects/9be746b1694a4bc88f24eb295ea612c1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:20.953710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7b0a-457b-4ac2-9e08-46aee579b659 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:20.954283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7b0a-457b-4ac2-9e08-46aee579b659 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:20.954390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7b0a-457b-4ac2-9e08-46aee579b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:20.975813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-279f7b0a-457b-4ac2-9e08-46aee579b659 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:20.977042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-279f7b0a-457b-4ac2-9e08-46aee579b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:21.052611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1217/2432] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:21.068371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c725-dcfa-4faf-8d76-9fb67d346606 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:21.068867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c725-dcfa-4faf-8d76-9fb67d346606 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:21.069380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c725-dcfa-4faf-8d76-9fb67d346606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:21.099161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ceb0c725-dcfa-4faf-8d76-9fb67d346606 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:21.101359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ceb0c725-dcfa-4faf-8d76-9fb67d346606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:21.114892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1216/2433] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:21.119660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7b0a-457b-4ac2-9e08-46aee579b659 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:21.140214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7b0a-457b-4ac2-9e08-46aee579b659 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:21.152970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:21.153444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:21.153764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:21.154040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:21.154728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:42:21.155040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:21.157662 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:21.183711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1218/2434] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:42:21.190477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c725-dcfa-4faf-8d76-9fb67d346606 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:21.206392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c725-dcfa-4faf-8d76-9fb67d346606 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:21.212340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799e5a1-87d3-47ac-8a64-185fcf83ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:21.213133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e5a1-87d3-47ac-8a64-185fcf83ce0d admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:21.213546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e5a1-87d3-47ac-8a64-185fcf83ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:21.213925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799e5a1-87d3-47ac-8a64-185fcf83ce0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:21.214645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799e5a1-87d3-47ac-8a64-185fcf83ce0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:21.216620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799e5a1-87d3-47ac-8a64-185fcf83ce0d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:21.258234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1217/2435] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:42:21 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:21.261507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:21.275511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:21.280105 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156b8d-6d04-4845-bb1e-b32281443f15 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:21.383163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfd826-25e9-433a-bb80-6c247ccab027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:21.384205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfd826-25e9-433a-bb80-6c247ccab027 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:21.384670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfd826-25e9-433a-bb80-6c247ccab027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:21.385038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfd826-25e9-433a-bb80-6c247ccab027 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:21.386484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfd826-25e9-433a-bb80-6c247ccab027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:21.391210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfd826-25e9-433a-bb80-6c247ccab027 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:21.448274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1219/2436] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:42:21 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:42:21.450027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799e5a1-87d3-47ac-8a64-185fcf83ce0d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:21.463881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799e5a1-87d3-47ac-8a64-185fcf83ce0d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:21.471340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a776757-aa81-401d-b7b3-ea88dde9e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:21.472301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a776757-aa81-401d-b7b3-ea88dde9e58a admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:21.472812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a776757-aa81-401d-b7b3-ea88dde9e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:21.473193 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a776757-aa81-401d-b7b3-ea88dde9e58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:21.474218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a776757-aa81-401d-b7b3-ea88dde9e58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:21.476360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a776757-aa81-401d-b7b3-ea88dde9e58a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:21.493756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1218/2437] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:21.497552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfd826-25e9-433a-bb80-6c247ccab027 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:21.512018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfd826-25e9-433a-bb80-6c247ccab027 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:21.517090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e086f-ae74-48fe-a125-691c542380d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:21.517767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e086f-ae74-48fe-a125-691c542380d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:21.518050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e086f-ae74-48fe-a125-691c542380d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:21.518325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e086f-ae74-48fe-a125-691c542380d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:21.518991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e086f-ae74-48fe-a125-691c542380d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:21.521041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e086f-ae74-48fe-a125-691c542380d4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:21.533802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1220/2438] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:42:21.539127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a776757-aa81-401d-b7b3-ea88dde9e58a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:21.563007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a776757-aa81-401d-b7b3-ea88dde9e58a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:21.569726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:21.570915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:21.570915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:21.571252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] PATH_INFO: `/v3/projects/577d5afc2582471ab2a822d71addfc05/users/34849dcf7bb340f780a3471a5f3ff7df/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:21.591126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] RBAC: Authorizing `identity:create_grant(project_id=577d5afc2582471ab2a822d71addfc05, user_id=34849dcf7bb340f780a3471a5f3ff7df, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:21.594150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:21.597919 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:21.637223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1219/2439] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:42:21 2022] PUT /identity/v3/projects/577d5afc2582471ab2a822d71addfc05/users/34849dcf7bb340f780a3471a5f3ff7df/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:21.730267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b783e6-2c3e-44fd-894a-2f658516f22e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:21.730594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b783e6-2c3e-44fd-894a-2f658516f22e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:21.730830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b783e6-2c3e-44fd-894a-2f658516f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:21.765729 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a6b783e6-2c3e-44fd-894a-2f658516f22e None None] MFA Rules not processed for user `34849dcf7bb340f780a3471a5f3ff7df`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:21.767404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a6b783e6-2c3e-44fd-894a-2f658516f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:21.900512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1221/2440] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:21.920659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:21.926191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:22.031738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a06e-024f-4946-b9bd-89d3a785688a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:22.042014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265925c9-fc1e-48eb-91c2-9bf7eeb036ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:22.042741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265925c9-fc1e-48eb-91c2-9bf7eeb036ec service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:22.043205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265925c9-fc1e-48eb-91c2-9bf7eeb036ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:22.043649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265925c9-fc1e-48eb-91c2-9bf7eeb036ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:22.056512 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265925c9-fc1e-48eb-91c2-9bf7eeb036ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:22.059145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265925c9-fc1e-48eb-91c2-9bf7eeb036ec service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:22.079185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1220/2441] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:26.505128 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b783e6-2c3e-44fd-894a-2f658516f22e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:26.588728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b783e6-2c3e-44fd-894a-2f658516f22e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:26.596348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:26.597454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:26.598010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:26.598520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] PATH_INFO: `/v3/users/34849dcf7bb340f780a3471a5f3ff7df` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:26.600505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=34849dcf7bb340f780a3471a5f3ff7df)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:26.604500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:26.624795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:26.663734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34849dcf7bb340f780a3471a5f3ff7df'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:26.664508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34849dcf7bb340f780a3471a5f3ff7df'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:26.672323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34849dcf7bb340f780a3471a5f3ff7df'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:26.673041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34849dcf7bb340f780a3471a5f3ff7df'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:26.682487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34849dcf7bb340f780a3471a5f3ff7df'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:26.706006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1222/2442] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:42:26 2022] DELETE /identity/v3/users/34849dcf7bb340f780a3471a5f3ff7df => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:42:26.711613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c9ec8-c4c9-428a-9db2-ed705695fa53 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:26.712181 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c9ec8-c4c9-428a-9db2-ed705695fa53 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:26.712588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c9ec8-c4c9-428a-9db2-ed705695fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:26.745394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-af2c9ec8-c4c9-428a-9db2-ed705695fa53 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:26.747444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-af2c9ec8-c4c9-428a-9db2-ed705695fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:26.823797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1221/2443] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:26.833952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:26.835512 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:26.896987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91c22f-469d-4b92-8016-84e528d7d8dc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:26.900880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:26.901533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:26.901847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:26.902120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:26.914074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:26.915540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:26.926275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1223/2444] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:27.351700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c9ec8-c4c9-428a-9db2-ed705695fa53 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:27.353968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-af2c9ec8-c4c9-428a-9db2-ed705695fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:27.375084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c9ec8-c4c9-428a-9db2-ed705695fa53 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:27.383822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:27.384574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:27.384899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:27.385256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] PATH_INFO: `/v3/projects/577d5afc2582471ab2a822d71addfc05` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:27.387253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=577d5afc2582471ab2a822d71addfc05)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:27.390100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:27.444692 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577d5afc2582471ab2a822d71addfc05', 'request_id': 'req-7ef05f89-e611-4476-840f-fdf7d28d4bf6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:27.452541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577d5afc2582471ab2a822d71addfc05', 'request_id': 'req-7ef05f89-e611-4476-840f-fdf7d28d4bf6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:27.459642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577d5afc2582471ab2a822d71addfc05', 'request_id': 'req-7ef05f89-e611-4476-840f-fdf7d28d4bf6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:27.475076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] The token cache is being invalidate because project 577d5afc2582471ab2a822d71addfc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:42:27.476203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:27.477716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7ef05f89-e611-4476-840f-fdf7d28d4bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:42:27.480429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1222/2445] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:42:27 2022] DELETE /identity/v3/projects/577d5afc2582471ab2a822d71addfc05 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:42:32.685445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:32.696515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:32.704748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d90ec-7676-4acd-959c-b5268c3dbada service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:32.766898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:32.767526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:32.767808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:32.768081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:32.770043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:32.819336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:32.836128 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:32.837623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:32.847081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1224/2446] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:37.455528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9589c-6e9d-43c9-8b4f-77f0b085d2b4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:37.456169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9589c-6e9d-43c9-8b4f-77f0b085d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:37.456273 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9589c-6e9d-43c9-8b4f-77f0b085d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:37.480589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-97e9589c-6e9d-43c9-8b4f-77f0b085d2b4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:37.482161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-97e9589c-6e9d-43c9-8b4f-77f0b085d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:37.496589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:42:37.549187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1223/2447] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:37.581833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:37.583505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:37.660861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d6c1c-30a8-42fc-b88e-a8cecf85f0ab service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:37.666332 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e939-aa9d-4942-84fe-846e0c71f23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:37.666944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e939-aa9d-4942-84fe-846e0c71f23f service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:37.667221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e939-aa9d-4942-84fe-846e0c71f23f service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:37.667492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e939-aa9d-4942-84fe-846e0c71f23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:37.676913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1e939-aa9d-4942-84fe-846e0c71f23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:37.679062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1e939-aa9d-4942-84fe-846e0c71f23f service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:37.689684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1225/2448] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:43.491236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715e95b-c6d5-4947-8fe9-a693f21415a7 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:43.491811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715e95b-c6d5-4947-8fe9-a693f21415a7 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:43.491811 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715e95b-c6d5-4947-8fe9-a693f21415a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:43.511606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6715e95b-c6d5-4947-8fe9-a693f21415a7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:43.512804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6715e95b-c6d5-4947-8fe9-a693f21415a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:43.520612 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1224/2449] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:43.547850 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e939-aa9d-4942-84fe-846e0c71f23f service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:43.558917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e939-aa9d-4942-84fe-846e0c71f23f service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:43.564471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:43.565058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:43.565335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:43.565633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:43.574118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:43.575663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:43.585945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1226/2450] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:47.801931 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fba305-bd23-406b-b31f-fa25a8999787 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:47.802484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fba305-bd23-406b-b31f-fa25a8999787 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:47.802620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fba305-bd23-406b-b31f-fa25a8999787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:47.823588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-61fba305-bd23-406b-b31f-fa25a8999787 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:47.824494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-61fba305-bd23-406b-b31f-fa25a8999787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:47.832435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1225/2451] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:47.858682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:47.860322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:47.875499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc2a4c-ca08-4c50-9a9e-757a618c2757 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:47.880960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fae61e-1810-4da2-8329-511a52bec6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:47.881644 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae61e-1810-4da2-8329-511a52bec6ef service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:47.881901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae61e-1810-4da2-8329-511a52bec6ef service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:47.882174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fae61e-1810-4da2-8329-511a52bec6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:47.890712 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fae61e-1810-4da2-8329-511a52bec6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:47.892274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fae61e-1810-4da2-8329-511a52bec6ef service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:47.901826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1227/2452] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:51.871155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ab2d-79e1-493d-bc74-a7e94f16fb10 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:51.871755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ab2d-79e1-493d-bc74-a7e94f16fb10 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:51.871755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400ab2d-79e1-493d-bc74-a7e94f16fb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:51.891046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2400ab2d-79e1-493d-bc74-a7e94f16fb10 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:51.892240 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2400ab2d-79e1-493d-bc74-a7e94f16fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:51.900500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1226/2453] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:51.929055 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fae61e-1810-4da2-8329-511a52bec6ef service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:51.940527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fae61e-1810-4da2-8329-511a52bec6ef service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:51.946160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a1a3-15b0-4860-895d-fd4f516f61b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:51.946725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a1a3-15b0-4860-895d-fd4f516f61b9 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:51.947009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a1a3-15b0-4860-895d-fd4f516f61b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:51.947286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0a1a3-15b0-4860-895d-fd4f516f61b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:51.955397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a1a3-15b0-4860-895d-fd4f516f61b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:51.956959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0a1a3-15b0-4860-895d-fd4f516f61b9 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:51.966839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1228/2454] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:42:57.118628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e094-2a95-44ba-8228-d151a537b2eb None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:57.119213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e094-2a95-44ba-8228-d151a537b2eb None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:57.119213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e094-2a95-44ba-8228-d151a537b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:57.139360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5e21e094-2a95-44ba-8228-d151a537b2eb None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:42:57.140573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5e21e094-2a95-44ba-8228-d151a537b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:42:57.148525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1227/2455] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:42:57.178024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a1a3-15b0-4860-895d-fd4f516f61b9 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:42:57.190143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0a1a3-15b0-4860-895d-fd4f516f61b9 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:42:57.196575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7e3dd-6588-4f3b-9e99-2843388cfb9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:42:57.197213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e3dd-6588-4f3b-9e99-2843388cfb9a service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:42:57.197495 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e3dd-6588-4f3b-9e99-2843388cfb9a service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:42:57.197802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7e3dd-6588-4f3b-9e99-2843388cfb9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:42:57.206532 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7e3dd-6588-4f3b-9e99-2843388cfb9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:42:57.208174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7e3dd-6588-4f3b-9e99-2843388cfb9a service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:42:57.217953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1229/2456] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:43:01.323472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c6c0-35e2-4ab4-8138-a07920897744 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:01.324039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c6c0-35e2-4ab4-8138-a07920897744 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:01.324039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68c6c0-35e2-4ab4-8138-a07920897744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:01.351303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3b68c6c0-35e2-4ab4-8138-a07920897744 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:43:01.352779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3b68c6c0-35e2-4ab4-8138-a07920897744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:43:01.363665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1228/2457] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:43:01.388882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7e3dd-6588-4f3b-9e99-2843388cfb9a service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:43:01.400826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7e3dd-6588-4f3b-9e99-2843388cfb9a service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:43:01.407195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d70d35-97fb-4de7-8fc5-348e0acddadb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:43:01.407801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d70d35-97fb-4de7-8fc5-348e0acddadb service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:01.408086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d70d35-97fb-4de7-8fc5-348e0acddadb service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:01.408362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d70d35-97fb-4de7-8fc5-348e0acddadb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:01.416811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d70d35-97fb-4de7-8fc5-348e0acddadb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:43:01.418429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d70d35-97fb-4de7-8fc5-348e0acddadb service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:43:01.428797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1230/2458] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:43:11.346055 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=33 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:43:11.423676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=71 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:43:19.916656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84eba-cf40-43bf-a19c-b05074a8d3e8 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:19.917230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84eba-cf40-43bf-a19c-b05074a8d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:19.917359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a84eba-cf40-43bf-a19c-b05074a8d3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:19.937743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-48a84eba-cf40-43bf-a19c-b05074a8d3e8 None None] MFA Rules not processed for user `eb7d935446c3444eb518498ed4bd01ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:43:19.938976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-48a84eba-cf40-43bf-a19c-b05074a8d3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:43:19.995506 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1229/2459] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:43:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:43:29.987835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=25 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:43:37.969462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c2c8-248d-4c6b-a526-e6ad32a11b04 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:37.969462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c2c8-248d-4c6b-a526-e6ad32a11b04 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:37.969974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c2c8-248d-4c6b-a526-e6ad32a11b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:37.989740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7b65c2c8-248d-4c6b-a526-e6ad32a11b04 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:43:37.990954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7b65c2c8-248d-4c6b-a526-e6ad32a11b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:43:37.999826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1231/2460] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:43:38.022050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a84eba-cf40-43bf-a19c-b05074a8d3e8 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:43:38.034959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a84eba-cf40-43bf-a19c-b05074a8d3e8 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:43:38.040514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3aa8d-7a24-48cc-9bb0-9ab0b680e18a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:43:38.041639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3aa8d-7a24-48cc-9bb0-9ab0b680e18a service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:38.041920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3aa8d-7a24-48cc-9bb0-9ab0b680e18a service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:38.042196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3aa8d-7a24-48cc-9bb0-9ab0b680e18a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:38.050445 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3aa8d-7a24-48cc-9bb0-9ab0b680e18a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:43:38.052187 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3aa8d-7a24-48cc-9bb0-9ab0b680e18a service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:43:38.062611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1230/2461] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:43:42.244296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1619-0616-43a2-81d1-30e5d7b2ac9c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:42.244838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1619-0616-43a2-81d1-30e5d7b2ac9c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:42.244838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf1619-0616-43a2-81d1-30e5d7b2ac9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:42.265608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-03cf1619-0616-43a2-81d1-30e5d7b2ac9c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:43:42.266852 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-03cf1619-0616-43a2-81d1-30e5d7b2ac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:43:42.274799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1232/2462] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:43:42.296684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3aa8d-7a24-48cc-9bb0-9ab0b680e18a service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:43:42.307977 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3aa8d-7a24-48cc-9bb0-9ab0b680e18a service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:43:42.314041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be32f4-8551-47f9-bb77-a35e33faec7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:43:42.314633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be32f4-8551-47f9-bb77-a35e33faec7c service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:42.314913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be32f4-8551-47f9-bb77-a35e33faec7c service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:42.315186 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be32f4-8551-47f9-bb77-a35e33faec7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:42.323402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be32f4-8551-47f9-bb77-a35e33faec7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:43:42.325035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be32f4-8551-47f9-bb77-a35e33faec7c service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:43:42.334779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1231/2463] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:43:46.390418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e5af-347c-4cc2-8756-8c9c3c3a7426 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:46.390933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e5af-347c-4cc2-8756-8c9c3c3a7426 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:46.391030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e5af-347c-4cc2-8756-8c9c3c3a7426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:46.410487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-1462e5af-347c-4cc2-8756-8c9c3c3a7426 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:43:46.411700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1462e5af-347c-4cc2-8756-8c9c3c3a7426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:43:46.420404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1233/2464] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:43:46.443958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be32f4-8551-47f9-bb77-a35e33faec7c service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:43:46.455950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be32f4-8551-47f9-bb77-a35e33faec7c service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:43:46.461463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33b54-4a7c-4d25-a910-1dca1dd9a6d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:43:46.462090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33b54-4a7c-4d25-a910-1dca1dd9a6d0 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:46.462388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33b54-4a7c-4d25-a910-1dca1dd9a6d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:46.462648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33b54-4a7c-4d25-a910-1dca1dd9a6d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:46.471947 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33b54-4a7c-4d25-a910-1dca1dd9a6d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:43:46.473603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33b54-4a7c-4d25-a910-1dca1dd9a6d0 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:43:46.483632 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1232/2465] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:43:51.612757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4b1d-33a9-453f-91a4-2f85b55937c5 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:51.613304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4b1d-33a9-453f-91a4-2f85b55937c5 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:51.613304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4b1d-33a9-453f-91a4-2f85b55937c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:51.633175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-65df4b1d-33a9-453f-91a4-2f85b55937c5 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:43:51.634551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-65df4b1d-33a9-453f-91a4-2f85b55937c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:43:51.642746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1234/2466] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:43:51.672105 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33b54-4a7c-4d25-a910-1dca1dd9a6d0 service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:43:51.683236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33b54-4a7c-4d25-a910-1dca1dd9a6d0 service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:43:51.688788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e53d0b-60f5-43e5-858e-c8202f172699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:43:51.689388 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53d0b-60f5-43e5-858e-c8202f172699 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:51.689700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53d0b-60f5-43e5-858e-c8202f172699 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:51.689978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53d0b-60f5-43e5-858e-c8202f172699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:51.698435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e53d0b-60f5-43e5-858e-c8202f172699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:43:51.700052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e53d0b-60f5-43e5-858e-c8202f172699 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:43:51.710276 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1233/2467] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:43:56.820076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0475c37-5bf9-4622-9e1f-363ee064807b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:56.820807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0475c37-5bf9-4622-9e1f-363ee064807b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:56.820807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0475c37-5bf9-4622-9e1f-363ee064807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:56.840124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f0475c37-5bf9-4622-9e1f-363ee064807b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:43:56.841865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f0475c37-5bf9-4622-9e1f-363ee064807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:43:56.849726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1235/2468] 10.222.0.49 () {58 vars in 1016 bytes} [Mon Oct 3 12:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:43:56.875798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e53d0b-60f5-43e5-858e-c8202f172699 service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:43:56.888491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e53d0b-60f5-43e5-858e-c8202f172699 service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:43:56.897668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:43:56.898486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:43:56.898762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:43:56.899034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:43:56.908596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:43:56.910611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:43:56.921548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1234/2469] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:06.834879 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=15 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:06.916281 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=30 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:13.796221 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78e17-b48b-4468-91f3-3d1b54beac33 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:13.796862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78e17-b48b-4468-91f3-3d1b54beac33 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:13.796862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78e17-b48b-4468-91f3-3d1b54beac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:13.816522 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-13e78e17-b48b-4468-91f3-3d1b54beac33 None None] MFA Rules not processed for user `a76145d9b91d477cb13d499eccff90d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:13.817751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-13e78e17-b48b-4468-91f3-3d1b54beac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:13.875812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1236/2470] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:44:13.979269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:13.980663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:14.036606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9e5a4-3a82-47f2-8ff0-e525346b6f18 service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:14.040263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:14.040882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:14.041165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:14.041449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:14.043226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:14.056684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:14.058167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:14.069659 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1235/2471] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:17.792334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78e17-b48b-4468-91f3-3d1b54beac33 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:17.794082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-13e78e17-b48b-4468-91f3-3d1b54beac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:17.805894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78e17-b48b-4468-91f3-3d1b54beac33 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:17.810059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:17.810792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:17.811111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:17.811386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:17.813076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:17.826947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:17.828375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:17.839677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1237/2472] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:21.519966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:21.532522 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85110cd-ed26-48f4-b6bf-25a9df308d05 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:21.539675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb266044-e738-4653-9b4c-1d8876ac9311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:21.540299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266044-e738-4653-9b4c-1d8876ac9311 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:21.540582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266044-e738-4653-9b4c-1d8876ac9311 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:21.540858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb266044-e738-4653-9b4c-1d8876ac9311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:21.542665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-eb266044-e738-4653-9b4c-1d8876ac9311 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:21.611378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb266044-e738-4653-9b4c-1d8876ac9311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:21.613224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb266044-e738-4653-9b4c-1d8876ac9311 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:21.636375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1236/2473] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:24.577374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:24.590668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ea3b-db4b-4551-b638-35605edac432 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:24.597081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:24.598118 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:24.598576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:24.599060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:24.600975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:24.667546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:24.669902 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:24.680235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1238/2474] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:31.618791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=54 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:34.675825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=59 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:35.752554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89047e1-9da1-4343-9d13-ed8ea6942b33 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:35.753065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89047e1-9da1-4343-9d13-ed8ea6942b33 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:35.753964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89047e1-9da1-4343-9d13-ed8ea6942b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:35.774154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-c89047e1-9da1-4343-9d13-ed8ea6942b33 None None] MFA Rules not processed for user `c29ecb6ed0f5439482957c4365aea4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:35.775443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c89047e1-9da1-4343-9d13-ed8ea6942b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:35.782954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1237/2475] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:44:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:44:36.111243 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:36.121111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4281a3-4a3e-4053-85e8-f6e4cc7b12d8 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:36.125745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:36.126357 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:36.126636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:36.126914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:36.128811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:36.139811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:36.141309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:36.151144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1239/2476] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:36.213438 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89047e1-9da1-4343-9d13-ed8ea6942b33 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:36.215305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c89047e1-9da1-4343-9d13-ed8ea6942b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:36.230290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89047e1-9da1-4343-9d13-ed8ea6942b33 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:36.235454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:36.242019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:36.242019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:36.242019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] PATH_INFO: `/v3/users/eb7d935446c3444eb518498ed4bd01ec` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:36.243158 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7d935446c3444eb518498ed4bd01ec)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:36.245743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:36.299256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7d935446c3444eb518498ed4bd01ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.306894 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7d935446c3444eb518498ed4bd01ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.307723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7d935446c3444eb518498ed4bd01ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.308374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7d935446c3444eb518498ed4bd01ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.316881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7d935446c3444eb518498ed4bd01ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.337283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1238/2477] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:44:36 2022] DELETE /identity/v3/users/eb7d935446c3444eb518498ed4bd01ec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:44:36.495684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:36.499303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:36.527045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:36.529926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:36.595535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006417e-357d-41b5-9377-6730027c3367 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:36.618899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c0615-5503-4ac5-85fa-0aeb166583bb admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:36.624523 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:36.625156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:36.625435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:36.625742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] PATH_INFO: `/v3/projects/25464e0762e340a2b26ec2a7e031a115` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:36.626858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25464e0762e340a2b26ec2a7e031a115)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:36.628772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:36.660199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25335857-dc18-4162-962f-63805e98efc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:36.661029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335857-dc18-4162-962f-63805e98efc8 service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:36.661296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335857-dc18-4162-962f-63805e98efc8 service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:36.661593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25335857-dc18-4162-962f-63805e98efc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:36.663533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-25335857-dc18-4162-962f-63805e98efc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:36.675114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25335857-dc18-4162-962f-63805e98efc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:36.676952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25335857-dc18-4162-962f-63805e98efc8 service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:36.680098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25464e0762e340a2b26ec2a7e031a115', 'request_id': 'req-7d833024-a98a-4bdd-b12d-740a3334f4c8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.687668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25464e0762e340a2b26ec2a7e031a115', 'request_id': 'req-7d833024-a98a-4bdd-b12d-740a3334f4c8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.688215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1240/2478] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:36.697764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25464e0762e340a2b26ec2a7e031a115', 'request_id': 'req-7d833024-a98a-4bdd-b12d-740a3334f4c8'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.703296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:36.712174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] The token cache is being invalidate because project 25464e0762e340a2b26ec2a7e031a115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:44:36.712849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.713951 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-7d833024-a98a-4bdd-b12d-740a3334f4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:44:36.716348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1239/2479] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:44:36 2022] DELETE /identity/v3/projects/25464e0762e340a2b26ec2a7e031a115 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:44:36.722120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1245af-a930-4f68-b18a-81d4807bddc7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:36.722405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1245af-a930-4f68-b18a-81d4807bddc7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:36.722684 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1245af-a930-4f68-b18a-81d4807bddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:36.744401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2e1245af-a930-4f68-b18a-81d4807bddc7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:36.746406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2e1245af-a930-4f68-b18a-81d4807bddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:36.815901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1241/2480] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:44:36.818329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa1f0-3883-48cc-ab07-35e85f3e6ebb None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:36.818799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa1f0-3883-48cc-ab07-35e85f3e6ebb None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:36.818911 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaa1f0-3883-48cc-ab07-35e85f3e6ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:36.839419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3bcaa1f0-3883-48cc-ab07-35e85f3e6ebb None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:36.841156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3bcaa1f0-3883-48cc-ab07-35e85f3e6ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:36.849006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1240/2481] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:44:36.853306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1245af-a930-4f68-b18a-81d4807bddc7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:36.863380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1245af-a930-4f68-b18a-81d4807bddc7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:36.869318 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:36.869991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:36.870274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:36.870551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:36.871203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:44:36.871511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:36.873139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:36.885875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1242/2482] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:44:36.890850 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa1f0-3883-48cc-ab07-35e85f3e6ebb None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:36.904949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaa1f0-3883-48cc-ab07-35e85f3e6ebb None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:36.914579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52d26a-fb95-4bba-8904-bb9f23474b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:36.915221 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52d26a-fb95-4bba-8904-bb9f23474b1f admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:36.915511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52d26a-fb95-4bba-8904-bb9f23474b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:36.915774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52d26a-fb95-4bba-8904-bb9f23474b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:36.916541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52d26a-fb95-4bba-8904-bb9f23474b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:36.918474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52d26a-fb95-4bba-8904-bb9f23474b1f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:36.947700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1241/2483] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:44:36 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:44:36.952380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:36.963451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0ab0a-ec95-44bf-b2f4-b1a57f74dc85 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:36.968945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:37.029365 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750d48e-3d41-4b20-95a4-c2907291b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:37.030076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750d48e-3d41-4b20-95a4-c2907291b8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:37.030363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750d48e-3d41-4b20-95a4-c2907291b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:37.030642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750d48e-3d41-4b20-95a4-c2907291b8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:37.031294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750d48e-3d41-4b20-95a4-c2907291b8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:37.033292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750d48e-3d41-4b20-95a4-c2907291b8f8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:37.056185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1243/2484] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:44:36 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:44:37.060854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52d26a-fb95-4bba-8904-bb9f23474b1f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:37.071956 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52d26a-fb95-4bba-8904-bb9f23474b1f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:37.077298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d6ff-297f-45b6-83d7-48675d7f1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:37.077946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d6ff-297f-45b6-83d7-48675d7f1f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:37.078231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d6ff-297f-45b6-83d7-48675d7f1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:37.078534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d6ff-297f-45b6-83d7-48675d7f1f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:37.079181 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0d6ff-297f-45b6-83d7-48675d7f1f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:37.080780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0d6ff-297f-45b6-83d7-48675d7f1f22 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:37.090939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1242/2485] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:44:37.095069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750d48e-3d41-4b20-95a4-c2907291b8f8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:37.105562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750d48e-3d41-4b20-95a4-c2907291b8f8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:37.110737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4273fb-0c7a-474a-8425-85287e47ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:37.111394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4273fb-0c7a-474a-8425-85287e47ab23 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:37.111980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4273fb-0c7a-474a-8425-85287e47ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:37.112098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4273fb-0c7a-474a-8425-85287e47ab23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:37.112673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4273fb-0c7a-474a-8425-85287e47ab23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:37.114376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4273fb-0c7a-474a-8425-85287e47ab23 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:37.125995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1244/2486] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:44:37.130298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d6ff-297f-45b6-83d7-48675d7f1f22 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:37.141663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d6ff-297f-45b6-83d7-48675d7f1f22 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:37.146389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:37.147180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:37.147467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:37.147746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] PATH_INFO: `/v3/projects/9b01de50206d4b40ae807acaab320209/users/7082356593d047a1ad4ff7821c59ed72/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:37.164305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b01de50206d4b40ae807acaab320209, user_id=7082356593d047a1ad4ff7821c59ed72, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:37.167022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:37.181624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1243/2487] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:44:37 2022] PUT /identity/v3/projects/9b01de50206d4b40ae807acaab320209/users/7082356593d047a1ad4ff7821c59ed72/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:44:37.187177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ef3a6-5e20-4f68-be8d-935297aa639a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:37.187536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ef3a6-5e20-4f68-be8d-935297aa639a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:37.187896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ef3a6-5e20-4f68-be8d-935297aa639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:37.207458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-334ef3a6-5e20-4f68-be8d-935297aa639a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:37.208690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-334ef3a6-5e20-4f68-be8d-935297aa639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:37.269566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1245/2488] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:44:37.279245 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:37.281010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:37.345602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a0ae-382a-4370-8b2a-c753b133d0b0 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:37.349622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dce4cd-2b83-4280-bf00-3de864776c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:37.350237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dce4cd-2b83-4280-bf00-3de864776c4b service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:37.350516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dce4cd-2b83-4280-bf00-3de864776c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:37.350784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dce4cd-2b83-4280-bf00-3de864776c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:37.360314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dce4cd-2b83-4280-bf00-3de864776c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:37.362228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dce4cd-2b83-4280-bf00-3de864776c4b service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:37.374088 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1244/2489] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:38.956114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ef3a6-5e20-4f68-be8d-935297aa639a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:38.979418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ef3a6-5e20-4f68-be8d-935297aa639a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:39.007145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:39.008142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:39.008435 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:39.008710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:39.010851 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:39.041661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:39.043140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:39.055256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1246/2490] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:41.939836 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9100-c0d9-4023-8677-5150de59a206 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:41.940373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9100-c0d9-4023-8677-5150de59a206 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:41.940474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9100-c0d9-4023-8677-5150de59a206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:41.973175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-9aae9100-c0d9-4023-8677-5150de59a206 None None] MFA Rules not processed for user `7082356593d047a1ad4ff7821c59ed72`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:41.974439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9aae9100-c0d9-4023-8677-5150de59a206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:42.045205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1245/2491] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:44:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:44:42.049635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:42.061737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cd59f-9ec3-4737-8258-32de03fff470 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:42.067575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726b92e-16d2-4c55-8292-04db63d1c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:42.068385 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726b92e-16d2-4c55-8292-04db63d1c669 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:42.068769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726b92e-16d2-4c55-8292-04db63d1c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:42.069457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726b92e-16d2-4c55-8292-04db63d1c669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:42.069918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726b92e-16d2-4c55-8292-04db63d1c669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:42.072287 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726b92e-16d2-4c55-8292-04db63d1c669 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:42.102058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1247/2492] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:44:42 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:44:42.106260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9100-c0d9-4023-8677-5150de59a206 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:42.117638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae9100-c0d9-4023-8677-5150de59a206 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:42.140038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:42.181102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b50561-5b86-40fe-8a48-1bf6e4cc037c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:42.181755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50561-5b86-40fe-8a48-1bf6e4cc037c admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:42.182039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50561-5b86-40fe-8a48-1bf6e4cc037c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:42.182316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50561-5b86-40fe-8a48-1bf6e4cc037c admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:42.182955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b50561-5b86-40fe-8a48-1bf6e4cc037c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:42.184910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b50561-5b86-40fe-8a48-1bf6e4cc037c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:42.206949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1246/2493] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:44:42 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:44:42.210968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726b92e-16d2-4c55-8292-04db63d1c669 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:42.222066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726b92e-16d2-4c55-8292-04db63d1c669 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:42.226865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8478a-863a-4870-9b71-bc35d627d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:42.227504 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8478a-863a-4870-9b71-bc35d627d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:42.227791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8478a-863a-4870-9b71-bc35d627d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:42.228072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8478a-863a-4870-9b71-bc35d627d3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:42.228717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8478a-863a-4870-9b71-bc35d627d3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:42.230353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8478a-863a-4870-9b71-bc35d627d3c4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:42.240423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1248/2494] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:44:42.244685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b50561-5b86-40fe-8a48-1bf6e4cc037c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:42.254905 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b50561-5b86-40fe-8a48-1bf6e4cc037c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:42.259497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ec5eb-1f67-4db6-bd88-0a9cac68f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:42.260397 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ec5eb-1f67-4db6-bd88-0a9cac68f584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:42.260691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ec5eb-1f67-4db6-bd88-0a9cac68f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:42.260970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ec5eb-1f67-4db6-bd88-0a9cac68f584 admin admin] PATH_INFO: `/v3/projects/b4060a4d2e304328b0198ddb37dd1d28/users/e535e92b842949ec86f96b791ef9f489/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:42.276169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ec5eb-1f67-4db6-bd88-0a9cac68f584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4060a4d2e304328b0198ddb37dd1d28, user_id=e535e92b842949ec86f96b791ef9f489, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:42.279516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ec5eb-1f67-4db6-bd88-0a9cac68f584 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:42.292139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1247/2495] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:44:42 2022] PUT /identity/v3/projects/b4060a4d2e304328b0198ddb37dd1d28/users/e535e92b842949ec86f96b791ef9f489/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:44:42.296091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8478a-863a-4870-9b71-bc35d627d3c4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:42.305984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8478a-863a-4870-9b71-bc35d627d3c4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:42.348253 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:42.370694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64e7d0-d41e-4d63-b359-c25fead785b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:42.371354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e7d0-d41e-4d63-b359-c25fead785b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:42.372193 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e7d0-d41e-4d63-b359-c25fead785b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:42.372473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e7d0-d41e-4d63-b359-c25fead785b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:42.373127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64e7d0-d41e-4d63-b359-c25fead785b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:42.374836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64e7d0-d41e-4d63-b359-c25fead785b4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:42.385611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1249/2496] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:44:42.390379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ec5eb-1f67-4db6-bd88-0a9cac68f584 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:42.400976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ec5eb-1f67-4db6-bd88-0a9cac68f584 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:42.406050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:42.406704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:42.406983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:42.407255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] PATH_INFO: `/v3/projects/b4060a4d2e304328b0198ddb37dd1d28/users/e535e92b842949ec86f96b791ef9f489/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:42.410059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4060a4d2e304328b0198ddb37dd1d28, user_id=e535e92b842949ec86f96b791ef9f489, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:42.412725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:42.423423 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1248/2497] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:44:42 2022] PUT /identity/v3/projects/b4060a4d2e304328b0198ddb37dd1d28/users/e535e92b842949ec86f96b791ef9f489/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:44:47.224470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40fec-209c-4e65-a378-fe104d015852 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:47.225425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40fec-209c-4e65-a378-fe104d015852 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:47.225889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce40fec-209c-4e65-a378-fe104d015852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:47.293942 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6ce40fec-209c-4e65-a378-fe104d015852 None None] MFA Rules not processed for user `e535e92b842949ec86f96b791ef9f489`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:47.295334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6ce40fec-209c-4e65-a378-fe104d015852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:47.408531 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1250/2498] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:44:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:44:47.420561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:47.422545 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:47.550825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349f518-9068-4b40-89d2-a2fa5889c147 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:47.555745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:47.556333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:47.556618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:47.556899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:47.650760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:47.652234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:47.664083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1249/2499] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:47.817733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8b56-cfb3-4c69-9c21-89debf40e302 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:47.818119 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8b56-cfb3-4c69-9c21-89debf40e302 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:47.818484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b8b56-cfb3-4c69-9c21-89debf40e302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:47.840510 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-709b8b56-cfb3-4c69-9c21-89debf40e302 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:47.841784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-709b8b56-cfb3-4c69-9c21-89debf40e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:47.902126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1251/2500] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:44:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:44:47.950900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:47.952422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:47.965893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:48.023775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd47057-8a81-4773-8169-698631c1b8a1 service glance] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:48.028940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ff67-6e8b-4c83-adcd-5b493b027b54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:48.029643 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff67-6e8b-4c83-adcd-5b493b027b54 service swift] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:48.030912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff67-6e8b-4c83-adcd-5b493b027b54 service swift] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:48.031190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff67-6e8b-4c83-adcd-5b493b027b54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:48.039518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664ff67-6e8b-4c83-adcd-5b493b027b54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:48.041103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664ff67-6e8b-4c83-adcd-5b493b027b54 service swift] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:48.049753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1250/2501] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:44:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:44:51.037128 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8b56-cfb3-4c69-9c21-89debf40e302 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:51.039436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-709b8b56-cfb3-4c69-9c21-89debf40e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:51.182716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:44:51.199216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b8b56-cfb3-4c69-9c21-89debf40e302 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:51.224032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:51.224670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:51.224957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:51.225235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:51.235008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:51.258390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:51.260019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:51.299233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1252/2502] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:57.700130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66a668-ecd0-4f73-99ca-d8f5318c0e2c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:57.700645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66a668-ecd0-4f73-99ca-d8f5318c0e2c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:57.700770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66a668-ecd0-4f73-99ca-d8f5318c0e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:57.720180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ec66a668-ecd0-4f73-99ca-d8f5318c0e2c None None] MFA Rules not processed for user `7082356593d047a1ad4ff7821c59ed72`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:57.721395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ec66a668-ecd0-4f73-99ca-d8f5318c0e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:57.728307 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1251/2503] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:44:57.989508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:44:58.044039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630963c-65fa-42e9-8402-90113697dcdf service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:44:58.047749 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:44:58.048363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:58.048646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:58.048918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:58.050685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:58.060780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:44:58.062239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:44:58.070252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1253/2504] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:44:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:44:59.957589 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575003e-0e6b-40a2-be57-0b75a1d22d59 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:44:59.958144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575003e-0e6b-40a2-be57-0b75a1d22d59 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:44:59.958144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575003e-0e6b-40a2-be57-0b75a1d22d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:44:59.977563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e575003e-0e6b-40a2-be57-0b75a1d22d59 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:44:59.978774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e575003e-0e6b-40a2-be57-0b75a1d22d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:44:59.996720 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1252/2505] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:45:00.009741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:45:00.022583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b479d31-d4b5-4841-b67f-ead3ba6d690d service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:45:00.027628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:45:00.028236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:45:00.028521 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:45:00.028822 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:45:00.037089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:45:00.038697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:45:00.047967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1254/2506] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 12:45:09.972970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=33 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:45:10.044935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=36 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:45:15.491628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575003e-0e6b-40a2-be57-0b75a1d22d59 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:45:15.511652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575003e-0e6b-40a2-be57-0b75a1d22d59 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:45:15.520559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:45:15.521630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:45:15.521953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:45:15.522837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:45:15.524786 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:45:15.541113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:45:15.543272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:45:15.556385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1253/2507] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:45:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:45:22.328843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:45:22.330481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:45:22.450311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf0fc-deab-47f1-9640-9ed900086a01 service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:45:22.458249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:45:22.458877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:45:22.459159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:45:22.459436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:45:22.461260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:45:22.474815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:45:22.476567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:45:22.488278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1255/2508] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:45:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:45:25.550508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=6 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:45:29.992968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:45:30.032031 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f2ccd-3d0a-4447-8d36-52b61ee77b3e service nova] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:45:30.035750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6baca6-6d37-4e86-836d-2c0cb854bd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:45:30.036355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6baca6-6d37-4e86-836d-2c0cb854bd85 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:45:30.036638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6baca6-6d37-4e86-836d-2c0cb854bd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:45:30.036916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6baca6-6d37-4e86-836d-2c0cb854bd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:45:30.046858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6baca6-6d37-4e86-836d-2c0cb854bd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:45:30.048299 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6baca6-6d37-4e86-836d-2c0cb854bd85 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:45:30.058594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1254/2509] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:45:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:45:32.483290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=28 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:45:37.610247 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:45:37.611774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:45:37.694026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c36fa-516e-4292-88b9-ebfd19ff2956 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:45:37.697803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:45:37.698426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:45:37.698738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:45:37.699028 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:45:37.700853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:45:37.760979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:45:37.762460 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:45:37.771580 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1256/2510] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:45:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:45:40.053990 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=18 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:45:47.767239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=57 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:45:50.372102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab0354-d076-41b3-aa82-ce4a397a3e62 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:45:50.372939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab0354-d076-41b3-aa82-ce4a397a3e62 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:45:50.372939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab0354-d076-41b3-aa82-ce4a397a3e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:45:50.398003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-5bab0354-d076-41b3-aa82-ce4a397a3e62 None None] MFA Rules not processed for user `1d98cbfc834a47b6ad7e1fa49357c778`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:45:50.399225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5bab0354-d076-41b3-aa82-ce4a397a3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:45:50.459109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1255/2511] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:45:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:00.450061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=25 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:46:03.333900 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:03.343359 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a652c-d00c-4d3e-8069-9fe278ad63a0 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:03.346978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7b9bb-497d-4c7c-9dda-8efb5ca35537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:03.347578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b9bb-497d-4c7c-9dda-8efb5ca35537 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:03.347892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b9bb-497d-4c7c-9dda-8efb5ca35537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:03.348166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b9bb-497d-4c7c-9dda-8efb5ca35537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:03.350057 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-85d7b9bb-497d-4c7c-9dda-8efb5ca35537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:03.436760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7b9bb-497d-4c7c-9dda-8efb5ca35537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:03.438236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7b9bb-497d-4c7c-9dda-8efb5ca35537 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:03.458169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1257/2512] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:46:05.384389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d7a2-e0f3-46f1-bd1e-7c5f322e6970 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:05.385231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d7a2-e0f3-46f1-bd1e-7c5f322e6970 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:05.385412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99d7a2-e0f3-46f1-bd1e-7c5f322e6970 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:05.386873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1256/2513] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:46:05.393292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead0484-f050-4a9e-8646-078a0ff17bb6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:05.394242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead0484-f050-4a9e-8646-078a0ff17bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:05.394630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead0484-f050-4a9e-8646-078a0ff17bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:05.460895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9ead0484-f050-4a9e-8646-078a0ff17bb6 None None] MFA Rules not processed for user `323b7d02f817475791098f32bf1c953e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:05.463577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9ead0484-f050-4a9e-8646-078a0ff17bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:05.472539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1258/2514] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:46:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:05.485658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d7a2-e0f3-46f1-bd1e-7c5f322e6970 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:05.487698 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-1e99d7a2-e0f3-46f1-bd1e-7c5f322e6970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:05.503063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99d7a2-e0f3-46f1-bd1e-7c5f322e6970 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:05.507419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ccc38-2e6d-43ed-864e-52757776f868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:05.508257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ccc38-2e6d-43ed-864e-52757776f868 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:05.508832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ccc38-2e6d-43ed-864e-52757776f868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:05.509287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ccc38-2e6d-43ed-864e-52757776f868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:05.517869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ccc38-2e6d-43ed-864e-52757776f868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:05.519305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ccc38-2e6d-43ed-864e-52757776f868 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:05.528936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1257/2515] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:46:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:46:05.626061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea54d6-ce6d-4056-9d96-304f05bb0b2c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:05.626407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea54d6-ce6d-4056-9d96-304f05bb0b2c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:05.626692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea54d6-ce6d-4056-9d96-304f05bb0b2c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:05.628275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1259/2516] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:46:05.633727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75da7d-658e-4769-88d1-de46edf9a18d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:05.634405 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75da7d-658e-4769-88d1-de46edf9a18d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:05.635151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75da7d-658e-4769-88d1-de46edf9a18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:05.658350 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3f75da7d-658e-4769-88d1-de46edf9a18d None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:05.660283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3f75da7d-658e-4769-88d1-de46edf9a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:05.692137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1258/2517] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:46:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:05.704466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea54d6-ce6d-4056-9d96-304f05bb0b2c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:05.717915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea54d6-ce6d-4056-9d96-304f05bb0b2c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:05.721702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9820255-bcda-4c3a-a570-71ca1fa347fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:05.722374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820255-bcda-4c3a-a570-71ca1fa347fb service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:05.722681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820255-bcda-4c3a-a570-71ca1fa347fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:05.723397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9820255-bcda-4c3a-a570-71ca1fa347fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:05.737360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9820255-bcda-4c3a-a570-71ca1fa347fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:05.739023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9820255-bcda-4c3a-a570-71ca1fa347fb service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:05.753234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1260/2518] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:46:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:46:07.719113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb568d86-8522-40b3-9aee-0727ead446f2 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:07.719743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb568d86-8522-40b3-9aee-0727ead446f2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:07.720046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb568d86-8522-40b3-9aee-0727ead446f2 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:07.721800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1259/2519] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:46:07.736390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec495-a1b3-473a-80f0-b65dbcf8479f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:07.736997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec495-a1b3-473a-80f0-b65dbcf8479f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:07.736997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec495-a1b3-473a-80f0-b65dbcf8479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:07.759234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-6afec495-a1b3-473a-80f0-b65dbcf8479f None None] MFA Rules not processed for user `d0886bba187b4d608cea7dcffed2c2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:07.762080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6afec495-a1b3-473a-80f0-b65dbcf8479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:07.809549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb568d86-8522-40b3-9aee-0727ead446f2 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:07.811431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-cb568d86-8522-40b3-9aee-0727ead446f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:07.829983 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb568d86-8522-40b3-9aee-0727ead446f2 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:07.835172 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:07.836279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:07.836972 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:07.837414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] PATH_INFO: `/v3/users/a76145d9b91d477cb13d499eccff90d6` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:07.839993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76145d9b91d477cb13d499eccff90d6)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:07.842421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:07.865719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1261/2520] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:46:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:07.879925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afec495-a1b3-473a-80f0-b65dbcf8479f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:07.881624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-6afec495-a1b3-473a-80f0-b65dbcf8479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:07.897132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afec495-a1b3-473a-80f0-b65dbcf8479f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:07.903207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76145d9b91d477cb13d499eccff90d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:07.906615 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb718-9e6d-45ad-9ee7-8b34db6604e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:07.907322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb718-9e6d-45ad-9ee7-8b34db6604e0 service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:07.907603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb718-9e6d-45ad-9ee7-8b34db6604e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:07.907878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bb718-9e6d-45ad-9ee7-8b34db6604e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:07.920125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bb718-9e6d-45ad-9ee7-8b34db6604e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:07.922007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bb718-9e6d-45ad-9ee7-8b34db6604e0 service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:07.922146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76145d9b91d477cb13d499eccff90d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:07.922935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76145d9b91d477cb13d499eccff90d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:07.923773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76145d9b91d477cb13d499eccff90d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:07.931414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:46:07.934015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96ae3471-4b26-49c8-855a-8770f6ac0f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76145d9b91d477cb13d499eccff90d6'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:07.940450 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1262/2521] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:46:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:46:07.961132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1260/2522] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:46:07 2022] DELETE /identity/v3/users/a76145d9b91d477cb13d499eccff90d6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:46:08.155120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb718-9e6d-45ad-9ee7-8b34db6604e0 service placement] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:08.168625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bb718-9e6d-45ad-9ee7-8b34db6604e0 service placement] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:08.275780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:08.276426 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.276706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.277022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] PATH_INFO: `/v3/projects/bb3d5847068a4bdd8006cdc198c7159c` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.278180 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3d5847068a4bdd8006cdc198c7159c)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:08.287309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:08.356786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3d5847068a4bdd8006cdc198c7159c', 'request_id': 'req-005c9c30-61c3-4c50-939a-2a95e5a370ca'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:08.366087 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3d5847068a4bdd8006cdc198c7159c', 'request_id': 'req-005c9c30-61c3-4c50-939a-2a95e5a370ca'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:08.375723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3d5847068a4bdd8006cdc198c7159c', 'request_id': 'req-005c9c30-61c3-4c50-939a-2a95e5a370ca'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:08.388931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] The token cache is being invalidate because project bb3d5847068a4bdd8006cdc198c7159c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:46:08.389147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:08.389991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-005c9c30-61c3-4c50-939a-2a95e5a370ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:46:08.395203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1263/2523] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:46:08 2022] DELETE /identity/v3/projects/bb3d5847068a4bdd8006cdc198c7159c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:46:08.396837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659705f0-8860-461f-bcf7-a869198df928 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.397123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659705f0-8860-461f-bcf7-a869198df928 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.397719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659705f0-8860-461f-bcf7-a869198df928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.478936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-659705f0-8860-461f-bcf7-a869198df928 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:08.481038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-659705f0-8860-461f-bcf7-a869198df928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:08.548960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1261/2524] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:08.556876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6014-12ad-4132-aab7-013da82d9096 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.557200 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6014-12ad-4132-aab7-013da82d9096 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.557588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef6014-12ad-4132-aab7-013da82d9096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.587423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9aef6014-12ad-4132-aab7-013da82d9096 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:08.589303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9aef6014-12ad-4132-aab7-013da82d9096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:08.600626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1264/2525] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:08.604670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659705f0-8860-461f-bcf7-a869198df928 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:08.615493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659705f0-8860-461f-bcf7-a869198df928 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:08.621308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:08.622204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.622682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.623155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.624024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:46:08.624511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:08.626452 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:08.640517 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1262/2526] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:46:08.645060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef6014-12ad-4132-aab7-013da82d9096 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:08.655742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef6014-12ad-4132-aab7-013da82d9096 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:08.662608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25bf4-73a1-49e0-ab28-a257dbc8b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:08.663273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25bf4-73a1-49e0-ab28-a257dbc8b42b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.663701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25bf4-73a1-49e0-ab28-a257dbc8b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.664832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25bf4-73a1-49e0-ab28-a257dbc8b42b admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.664832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25bf4-73a1-49e0-ab28-a257dbc8b42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:08.666948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f25bf4-73a1-49e0-ab28-a257dbc8b42b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:08.710978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1265/2527] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:46:08 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:46:08.715148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:08.725289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed925151-0a9b-4dcc-a89a-9601e049fa5a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:08.738241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:46:08.788220 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee1478-0a19-4f1b-be47-03c3af769b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:08.788837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1478-0a19-4f1b-be47-03c3af769b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.789118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1478-0a19-4f1b-be47-03c3af769b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.789393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1478-0a19-4f1b-be47-03c3af769b74 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.790075 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee1478-0a19-4f1b-be47-03c3af769b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:08.792122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee1478-0a19-4f1b-be47-03c3af769b74 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:08.817949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1263/2528] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:46:08 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:46:08.822626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25bf4-73a1-49e0-ab28-a257dbc8b42b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:08.837632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25bf4-73a1-49e0-ab28-a257dbc8b42b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:08.842465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2bce-e8cc-476c-8f6d-482d17767214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:08.843175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2bce-e8cc-476c-8f6d-482d17767214 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.843518 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2bce-e8cc-476c-8f6d-482d17767214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.843866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2bce-e8cc-476c-8f6d-482d17767214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.844620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff2bce-e8cc-476c-8f6d-482d17767214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:08.846331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff2bce-e8cc-476c-8f6d-482d17767214 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:08.860614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1266/2529] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:46:08.861912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee1478-0a19-4f1b-be47-03c3af769b74 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:08.873668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee1478-0a19-4f1b-be47-03c3af769b74 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:08.879436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bbe03-56c5-4f63-8492-679a3ddf72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:08.880429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bbe03-56c5-4f63-8492-679a3ddf72bb admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.880572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bbe03-56c5-4f63-8492-679a3ddf72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.881176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bbe03-56c5-4f63-8492-679a3ddf72bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.881413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bbe03-56c5-4f63-8492-679a3ddf72bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:08.883198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bbe03-56c5-4f63-8492-679a3ddf72bb admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:08.895629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1264/2530] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:46:08.899690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2bce-e8cc-476c-8f6d-482d17767214 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:08.910342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2bce-e8cc-476c-8f6d-482d17767214 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:08.916567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:08.917252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.918088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.918378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] PATH_INFO: `/v3/projects/2bd3cb6dc02b419da8d1a25b8ae63fe5/users/357459a31a3a4fedb2af627c317abc2a/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.938985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd3cb6dc02b419da8d1a25b8ae63fe5, user_id=357459a31a3a4fedb2af627c317abc2a, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:08.943157 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:08.959259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1267/2531] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:46:08 2022] PUT /identity/v3/projects/2bd3cb6dc02b419da8d1a25b8ae63fe5/users/357459a31a3a4fedb2af627c317abc2a/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:46:08.965126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ce21-a22e-4f86-b3f1-42350e17224b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:08.965650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ce21-a22e-4f86-b3f1-42350e17224b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:08.966097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894ce21-a22e-4f86-b3f1-42350e17224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:08.992829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-0894ce21-a22e-4f86-b3f1-42350e17224b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:08.994592 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0894ce21-a22e-4f86-b3f1-42350e17224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:09.069058 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1265/2532] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:09.076738 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:09.081660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:09.112370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:46:09.164533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75279c0-ac61-49b2-bbd3-7c70bfcd7da8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:09.168742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:09.169356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:09.169667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:09.169945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:09.180463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:09.182044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:09.194127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1268/2533] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:46:13.803396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb508-5dc4-4b85-b600-5b830220a5a4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:13.803926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb508-5dc4-4b85-b600-5b830220a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:13.804048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb508-5dc4-4b85-b600-5b830220a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:13.834293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7fafb508-5dc4-4b85-b600-5b830220a5a4 None None] MFA Rules not processed for user `357459a31a3a4fedb2af627c317abc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:13.835503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7fafb508-5dc4-4b85-b600-5b830220a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:13.906225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1266/2534] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:46:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:46:13.928117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:46:13.930576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:14.025001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63515-3868-4997-a0d9-d34ee6be2a98 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:46:14.031873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1507f-f4a7-4477-affd-9d1b9054d5bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:46:14.032030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1507f-f4a7-4477-affd-9d1b9054d5bd service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:14.032314 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1507f-f4a7-4477-affd-9d1b9054d5bd service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:14.032679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1507f-f4a7-4477-affd-9d1b9054d5bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:14.041133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1507f-f4a7-4477-affd-9d1b9054d5bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:46:14.043458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1507f-f4a7-4477-affd-9d1b9054d5bd service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:46:14.054658 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1269/2535] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:46:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:46:15.535214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea139e3-c49e-4738-b18c-55b3080d3d55 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:15.535753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea139e3-c49e-4738-b18c-55b3080d3d55 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:15.535753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea139e3-c49e-4738-b18c-55b3080d3d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:15.555057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7ea139e3-c49e-4738-b18c-55b3080d3d55 None None] MFA Rules not processed for user `357459a31a3a4fedb2af627c317abc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:15.556280 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7ea139e3-c49e-4738-b18c-55b3080d3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:15.563906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1267/2536] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:46:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:24.048885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=52 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:46:25.550112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:46:47.806941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e00b6f-4413-4b81-9b54-22bc24c27eff None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:46:47.807577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e00b6f-4413-4b81-9b54-22bc24c27eff None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:46:47.807577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e00b6f-4413-4b81-9b54-22bc24c27eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:46:47.829175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-63e00b6f-4413-4b81-9b54-22bc24c27eff None None] MFA Rules not processed for user `c29ecb6ed0f5439482957c4365aea4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:46:47.830449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-63e00b6f-4413-4b81-9b54-22bc24c27eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:46:47.916706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1270/2537] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:46:57.906260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=25 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:47:54.771929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea139e3-c49e-4738-b18c-55b3080d3d55 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:47:54.773579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7ea139e3-c49e-4738-b18c-55b3080d3d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:47:54.869237 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea139e3-c49e-4738-b18c-55b3080d3d55 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:47:54.874837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:47:54.875465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:47:54.875744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:47:54.876046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:47:54.877933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:47:54.890214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:47:54.891731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:47:54.903201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1268/2538] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:47:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:00.331734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e00b6f-4413-4b81-9b54-22bc24c27eff None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:00.333162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-63e00b6f-4413-4b81-9b54-22bc24c27eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:00.345159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e00b6f-4413-4b81-9b54-22bc24c27eff None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:00.348797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:00.349416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:00.349732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:00.350009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:00.351939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:00.364603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:00.366066 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:00.376573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1271/2539] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:03.672792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:03.674298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:03.687838 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43369a-bd3c-4652-b900-eba8afff7845 service placement] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:03.695963 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:03.697099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:03.697099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:03.697314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:03.702090 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:03.718667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:03.720334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:03.732609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1269/2540] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:03.770916 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:03.774299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:03.790783 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554608-5359-4ab2-946a-bbe59ee58388 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:03.795519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:03.796168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:03.796452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:03.796730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] PATH_INFO: `/v3/users/1d98cbfc834a47b6ad7e1fa49357c778` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:03.797931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d98cbfc834a47b6ad7e1fa49357c778)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:03.799907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:03.856283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d98cbfc834a47b6ad7e1fa49357c778'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:03.856974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d98cbfc834a47b6ad7e1fa49357c778'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:03.864975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d98cbfc834a47b6ad7e1fa49357c778'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:03.865763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d98cbfc834a47b6ad7e1fa49357c778'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:03.874979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-44769df5-beba-41ac-8725-e34c10c42334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d98cbfc834a47b6ad7e1fa49357c778'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:03.896857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1272/2541] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:03 2022] DELETE /identity/v3/users/1d98cbfc834a47b6ad7e1fa49357c778 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:04.093062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:04.106634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc698f5-d693-433c-8940-08914d41b007 service placement] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:04.168955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:04.169626 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.169913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.170194 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] PATH_INFO: `/v3/projects/9b6085d469c748039a90bb21e8e94863` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.171378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6085d469c748039a90bb21e8e94863)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:04.173325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:04.229977 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6085d469c748039a90bb21e8e94863', 'request_id': 'req-84465046-079a-476b-8f73-8aabbc51f211'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:04.238064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6085d469c748039a90bb21e8e94863', 'request_id': 'req-84465046-079a-476b-8f73-8aabbc51f211'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:04.240222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:04.249881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6085d469c748039a90bb21e8e94863', 'request_id': 'req-84465046-079a-476b-8f73-8aabbc51f211'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:04.265089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] The token cache is being invalidate because project 9b6085d469c748039a90bb21e8e94863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:04.265429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:04.266120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-84465046-079a-476b-8f73-8aabbc51f211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:04.267675 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1270/2542] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:04 2022] DELETE /identity/v3/projects/9b6085d469c748039a90bb21e8e94863 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:04.272679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf9d4-fbf9-4c21-84c8-9c2696781812 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.273007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf9d4-fbf9-4c21-84c8-9c2696781812 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.273299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ebf9d4-fbf9-4c21-84c8-9c2696781812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.293339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-23ebf9d4-fbf9-4c21-84c8-9c2696781812 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:04.294615 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-23ebf9d4-fbf9-4c21-84c8-9c2696781812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:04.370762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1273/2543] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:04.378889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aced0-2a89-45c7-a0af-bb7018c9a6fa None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.379315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aced0-2a89-45c7-a0af-bb7018c9a6fa None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.379534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aced0-2a89-45c7-a0af-bb7018c9a6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.400471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3f9aced0-2a89-45c7-a0af-bb7018c9a6fa None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:04.401736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3f9aced0-2a89-45c7-a0af-bb7018c9a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:04.409961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1271/2544] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:48:04.415102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebf9d4-fbf9-4c21-84c8-9c2696781812 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:04.425672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ebf9d4-fbf9-4c21-84c8-9c2696781812 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:04.431764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:04.432470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.432748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.433021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.433770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:48:04.434074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:04.435940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:04.451853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1274/2545] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:48:04.457039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aced0-2a89-45c7-a0af-bb7018c9a6fa None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:04.471053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aced0-2a89-45c7-a0af-bb7018c9a6fa None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:04.478232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b894b-950f-4fed-9ccf-4c7e55ab5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:04.479053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b894b-950f-4fed-9ccf-4c7e55ab5709 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.479392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b894b-950f-4fed-9ccf-4c7e55ab5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.479729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b894b-950f-4fed-9ccf-4c7e55ab5709 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.480613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b894b-950f-4fed-9ccf-4c7e55ab5709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:04.482764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b894b-950f-4fed-9ccf-4c7e55ab5709 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:04.517316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1272/2546] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:04 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:04.518454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:04.529876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1cddd-07fa-4aa9-bfb0-6dad5e655418 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:04.580288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:04.594836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a369b-b370-4b17-9ab5-a308f50d859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:04.595453 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a369b-b370-4b17-9ab5-a308f50d859d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.595751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a369b-b370-4b17-9ab5-a308f50d859d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.596012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a369b-b370-4b17-9ab5-a308f50d859d admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.596665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a369b-b370-4b17-9ab5-a308f50d859d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:04.598657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a369b-b370-4b17-9ab5-a308f50d859d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:04.623472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1275/2547] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:04 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:48:04.627839 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b894b-950f-4fed-9ccf-4c7e55ab5709 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:04.640304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b894b-950f-4fed-9ccf-4c7e55ab5709 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:04.646375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176d9f7-79b1-4437-a045-7c07d541ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:04.647016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176d9f7-79b1-4437-a045-7c07d541ebad admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.647550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176d9f7-79b1-4437-a045-7c07d541ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.647971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176d9f7-79b1-4437-a045-7c07d541ebad admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.649324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176d9f7-79b1-4437-a045-7c07d541ebad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:04.650968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176d9f7-79b1-4437-a045-7c07d541ebad admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:04.662207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1273/2548] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:48:04.666244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a369b-b370-4b17-9ab5-a308f50d859d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:04.676403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a369b-b370-4b17-9ab5-a308f50d859d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:04.681632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade41e8-bf2d-4365-8938-e8c120742043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:04.682246 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade41e8-bf2d-4365-8938-e8c120742043 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.682525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade41e8-bf2d-4365-8938-e8c120742043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.682796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade41e8-bf2d-4365-8938-e8c120742043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.683466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade41e8-bf2d-4365-8938-e8c120742043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:04.685137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade41e8-bf2d-4365-8938-e8c120742043 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:04.696950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1276/2549] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:04.701461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176d9f7-79b1-4437-a045-7c07d541ebad admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:04.711886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176d9f7-79b1-4437-a045-7c07d541ebad admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:04.716869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:04.718014 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.718509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.719016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] PATH_INFO: `/v3/projects/5cc803e62b454c3bb33a16539d26da47/users/05762101d49645a9a3bb6e82acfb1a87/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.738178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc803e62b454c3bb33a16539d26da47, user_id=05762101d49645a9a3bb6e82acfb1a87, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:04.740841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:04.755904 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1274/2550] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:04 2022] PUT /identity/v3/projects/5cc803e62b454c3bb33a16539d26da47/users/05762101d49645a9a3bb6e82acfb1a87/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:04.768149 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d370a-19bd-49da-b792-4a405c6572e4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.768327 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d370a-19bd-49da-b792-4a405c6572e4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.768594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d370a-19bd-49da-b792-4a405c6572e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:04.797273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-bc3d370a-19bd-49da-b792-4a405c6572e4 None None] MFA Rules not processed for user `05762101d49645a9a3bb6e82acfb1a87`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:04.798664 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-bc3d370a-19bd-49da-b792-4a405c6572e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:04.863400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1277/2551] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:04.875762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:04.877446 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:04.984743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95103fcb-f82e-4bb6-88dc-b9b6ea8ff1ac admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:04.990685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8403a-e4ca-4a64-9a7a-a299f59d06fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:04.991291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8403a-e4ca-4a64-9a7a-a299f59d06fa service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:04.991572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8403a-e4ca-4a64-9a7a-a299f59d06fa service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:04.992346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8403a-e4ca-4a64-9a7a-a299f59d06fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:05.000858 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8403a-e4ca-4a64-9a7a-a299f59d06fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:05.002501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8403a-e4ca-4a64-9a7a-a299f59d06fa service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:05.012851 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1275/2552] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:10.234868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d370a-19bd-49da-b792-4a405c6572e4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:10.296142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d370a-19bd-49da-b792-4a405c6572e4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:10.300838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:10.301470 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:10.301785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:10.302062 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] PATH_INFO: `/v3/users/05762101d49645a9a3bb6e82acfb1a87` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:10.303182 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05762101d49645a9a3bb6e82acfb1a87)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:10.305680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:10.352186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05762101d49645a9a3bb6e82acfb1a87'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.352840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05762101d49645a9a3bb6e82acfb1a87'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.359832 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05762101d49645a9a3bb6e82acfb1a87'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.360471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05762101d49645a9a3bb6e82acfb1a87'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.362218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:10.368896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05762101d49645a9a3bb6e82acfb1a87'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.387754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1278/2553] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:10 2022] DELETE /identity/v3/users/05762101d49645a9a3bb6e82acfb1a87 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:10.392207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811c2a1-1b30-41c2-bcdb-e2f595d420dc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:10.392718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811c2a1-1b30-41c2-bcdb-e2f595d420dc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:10.392830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811c2a1-1b30-41c2-bcdb-e2f595d420dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:10.423052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b811c2a1-1b30-41c2-bcdb-e2f595d420dc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:10.424267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b811c2a1-1b30-41c2-bcdb-e2f595d420dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:10.463316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:10.487061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1276/2554] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:10.497729 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:10.499238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:10.564817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939ffca-7131-44a0-889a-b2bde29b3055 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:10.569364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373147b1-e212-4e72-b929-f4f89b6b4b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:10.570175 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147b1-e212-4e72-b929-f4f89b6b4b49 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:10.570461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147b1-e212-4e72-b929-f4f89b6b4b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:10.570767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373147b1-e212-4e72-b929-f4f89b6b4b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:10.580635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373147b1-e212-4e72-b929-f4f89b6b4b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:10.582130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373147b1-e212-4e72-b929-f4f89b6b4b49 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:10.591520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1279/2555] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:10.871939 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811c2a1-1b30-41c2-bcdb-e2f595d420dc None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:10.874098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b811c2a1-1b30-41c2-bcdb-e2f595d420dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:10.887660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811c2a1-1b30-41c2-bcdb-e2f595d420dc None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:10.893016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:10.893707 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:10.894427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:10.894427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] PATH_INFO: `/v3/projects/5cc803e62b454c3bb33a16539d26da47` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:10.895567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc803e62b454c3bb33a16539d26da47)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:10.897531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:10.950066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc803e62b454c3bb33a16539d26da47', 'request_id': 'req-96b731e1-fc11-460d-abe9-49b2b2e0f387'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.958190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc803e62b454c3bb33a16539d26da47', 'request_id': 'req-96b731e1-fc11-460d-abe9-49b2b2e0f387'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.965771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc803e62b454c3bb33a16539d26da47', 'request_id': 'req-96b731e1-fc11-460d-abe9-49b2b2e0f387'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.979096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] The token cache is being invalidate because project 5cc803e62b454c3bb33a16539d26da47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:10.979096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.979801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96b731e1-fc11-460d-abe9-49b2b2e0f387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:10.981794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1277/2556] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:10 2022] DELETE /identity/v3/projects/5cc803e62b454c3bb33a16539d26da47 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:10.986549 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ba92e-ad87-4a48-91ce-ed92f5a9b479 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:10.986855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ba92e-ad87-4a48-91ce-ed92f5a9b479 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:10.987135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ba92e-ad87-4a48-91ce-ed92f5a9b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.007529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d57ba92e-ad87-4a48-91ce-ed92f5a9b479 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:11.008987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d57ba92e-ad87-4a48-91ce-ed92f5a9b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:11.083630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1280/2557] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:11.089646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333e89-7b3b-4160-89ba-8d82207eaf4d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.089934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333e89-7b3b-4160-89ba-8d82207eaf4d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.090213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f333e89-7b3b-4160-89ba-8d82207eaf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.110157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3f333e89-7b3b-4160-89ba-8d82207eaf4d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:11.111359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3f333e89-7b3b-4160-89ba-8d82207eaf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:11.119362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1278/2558] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:11.123680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ba92e-ad87-4a48-91ce-ed92f5a9b479 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:11.134939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ba92e-ad87-4a48-91ce-ed92f5a9b479 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:11.139571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:11.140177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.140575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.140850 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.141497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:48:11.141829 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:11.143415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:11.157594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1281/2559] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:48:11.161824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333e89-7b3b-4160-89ba-8d82207eaf4d None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:11.171655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f333e89-7b3b-4160-89ba-8d82207eaf4d None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:11.176529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5426-f8ac-4ef3-985f-90a638cba5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:11.177136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5426-f8ac-4ef3-985f-90a638cba5ea admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.177420 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5426-f8ac-4ef3-985f-90a638cba5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.177730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5426-f8ac-4ef3-985f-90a638cba5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.178381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d5426-f8ac-4ef3-985f-90a638cba5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:11.180297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d5426-f8ac-4ef3-985f-90a638cba5ea admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:11.211089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1279/2560] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:11 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:11.215177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:11.225963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f6ecb-94f1-4901-bf97-efaa520b955d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:11.283682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24eb2d-d124-4e7d-af7e-9b29f8c46c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:11.284382 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24eb2d-d124-4e7d-af7e-9b29f8c46c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.284590 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24eb2d-d124-4e7d-af7e-9b29f8c46c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.284855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24eb2d-d124-4e7d-af7e-9b29f8c46c2b admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.285498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24eb2d-d124-4e7d-af7e-9b29f8c46c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:11.287448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24eb2d-d124-4e7d-af7e-9b29f8c46c2b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:11.297901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:11.310114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1282/2561] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:11 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:11.314457 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5426-f8ac-4ef3-985f-90a638cba5ea admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:11.325351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5426-f8ac-4ef3-985f-90a638cba5ea admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:11.330034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ef19-4b58-4d20-924e-a25dffaf524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:11.330644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ef19-4b58-4d20-924e-a25dffaf524e admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.330919 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ef19-4b58-4d20-924e-a25dffaf524e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.331189 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4ef19-4b58-4d20-924e-a25dffaf524e admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.331825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4ef19-4b58-4d20-924e-a25dffaf524e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:11.333421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4ef19-4b58-4d20-924e-a25dffaf524e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:11.344467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1280/2562] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:11.348636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24eb2d-d124-4e7d-af7e-9b29f8c46c2b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:11.359397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24eb2d-d124-4e7d-af7e-9b29f8c46c2b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:11.364542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5afaa-3967-4871-b47e-9e58a0a9721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:11.365148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5afaa-3967-4871-b47e-9e58a0a9721b admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.365446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5afaa-3967-4871-b47e-9e58a0a9721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.365756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5afaa-3967-4871-b47e-9e58a0a9721b admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.366406 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5afaa-3967-4871-b47e-9e58a0a9721b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:11.368025 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5afaa-3967-4871-b47e-9e58a0a9721b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:11.380237 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1283/2563] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:11.392030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ef19-4b58-4d20-924e-a25dffaf524e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:11.404772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4ef19-4b58-4d20-924e-a25dffaf524e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:11.412799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:11.414068 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.414582 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.415099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] PATH_INFO: `/v3/projects/2ff4595a999e42d8996db41a47a3e1a6/users/149a1ce20ed34966a25903f89c225a00/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.434313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff4595a999e42d8996db41a47a3e1a6, user_id=149a1ce20ed34966a25903f89c225a00, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:11.436968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:11.452021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1281/2564] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:11 2022] PUT /identity/v3/projects/2ff4595a999e42d8996db41a47a3e1a6/users/149a1ce20ed34966a25903f89c225a00/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:11.463325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497d74-6d8c-47ab-af29-07644eb7e180 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.463542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497d74-6d8c-47ab-af29-07644eb7e180 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.463847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497d74-6d8c-47ab-af29-07644eb7e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.493947 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d6497d74-6d8c-47ab-af29-07644eb7e180 None None] MFA Rules not processed for user `149a1ce20ed34966a25903f89c225a00`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:11.495204 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d6497d74-6d8c-47ab-af29-07644eb7e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:11.571188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1284/2565] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:11.588013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:11.590201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:11.658990 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:11.676595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6e078-e264-4f3b-a90d-59bd77533b00 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:11.682456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c554ced-39a7-46fd-82c2-451bd5fce834 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:11.683066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554ced-39a7-46fd-82c2-451bd5fce834 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:11.683347 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554ced-39a7-46fd-82c2-451bd5fce834 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:11.683622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c554ced-39a7-46fd-82c2-451bd5fce834 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:11.691954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c554ced-39a7-46fd-82c2-451bd5fce834 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:11.693755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c554ced-39a7-46fd-82c2-451bd5fce834 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:11.706521 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1282/2566] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:14.455116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6497d74-6d8c-47ab-af29-07644eb7e180 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:14.516925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6497d74-6d8c-47ab-af29-07644eb7e180 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:14.521333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:14.522003 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:14.522394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:14.522585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] PATH_INFO: `/v3/users/149a1ce20ed34966a25903f89c225a00` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:14.523709 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149a1ce20ed34966a25903f89c225a00)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:14.525704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:14.576801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149a1ce20ed34966a25903f89c225a00'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:14.577461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149a1ce20ed34966a25903f89c225a00'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:14.584429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149a1ce20ed34966a25903f89c225a00'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:14.585133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149a1ce20ed34966a25903f89c225a00'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:14.592864 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149a1ce20ed34966a25903f89c225a00'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:14.601150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:14.614199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1285/2567] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:14 2022] DELETE /identity/v3/users/149a1ce20ed34966a25903f89c225a00 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:14.619664 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a1b94-c1b0-4c45-beab-912970384729 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:14.620169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a1b94-c1b0-4c45-beab-912970384729 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:14.620416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a1b94-c1b0-4c45-beab-912970384729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:14.643620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-de6a1b94-c1b0-4c45-beab-912970384729 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:14.645201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-de6a1b94-c1b0-4c45-beab-912970384729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:14.708608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1283/2568] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:14.718624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:14.720162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:14.779585 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4eab8-18c6-4aec-b582-43d772a7aa78 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:14.783230 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05382-035e-4268-8bee-3c6ce0a6dc27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:14.783843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05382-035e-4268-8bee-3c6ce0a6dc27 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:14.784120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05382-035e-4268-8bee-3c6ce0a6dc27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:14.784388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05382-035e-4268-8bee-3c6ce0a6dc27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:14.797137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c05382-035e-4268-8bee-3c6ce0a6dc27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:14.797137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c05382-035e-4268-8bee-3c6ce0a6dc27 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:14.806545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1286/2569] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:15.093714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a1b94-c1b0-4c45-beab-912970384729 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:15.095456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-de6a1b94-c1b0-4c45-beab-912970384729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:15.113392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a1b94-c1b0-4c45-beab-912970384729 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:15.120700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:15.121825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.122328 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.122825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] PATH_INFO: `/v3/projects/2ff4595a999e42d8996db41a47a3e1a6` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.124790 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff4595a999e42d8996db41a47a3e1a6)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:15.128668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:15.180741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff4595a999e42d8996db41a47a3e1a6', 'request_id': 'req-da815c27-9521-47c4-8cfa-6e53da5eb1a5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:15.190336 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff4595a999e42d8996db41a47a3e1a6', 'request_id': 'req-da815c27-9521-47c4-8cfa-6e53da5eb1a5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:15.197424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff4595a999e42d8996db41a47a3e1a6', 'request_id': 'req-da815c27-9521-47c4-8cfa-6e53da5eb1a5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:15.211200 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] The token cache is being invalidate because project 2ff4595a999e42d8996db41a47a3e1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:15.211486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:15.212493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-da815c27-9521-47c4-8cfa-6e53da5eb1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:15.214326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1284/2570] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:15 2022] DELETE /identity/v3/projects/2ff4595a999e42d8996db41a47a3e1a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:48:15.221910 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203c49-16cc-4dae-93a4-c30e2d0fcccc None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.222225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203c49-16cc-4dae-93a4-c30e2d0fcccc None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.222499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0203c49-16cc-4dae-93a4-c30e2d0fcccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.244167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b0203c49-16cc-4dae-93a4-c30e2d0fcccc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:15.246364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b0203c49-16cc-4dae-93a4-c30e2d0fcccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:15.312179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1287/2571] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:15.321581 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b423afb-e7ce-4d32-b8ca-f431be8f74b9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.321866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b423afb-e7ce-4d32-b8ca-f431be8f74b9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.322141 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b423afb-e7ce-4d32-b8ca-f431be8f74b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.343411 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-0b423afb-e7ce-4d32-b8ca-f431be8f74b9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:15.344636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0b423afb-e7ce-4d32-b8ca-f431be8f74b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:15.353190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1285/2572] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:48:15.357641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0203c49-16cc-4dae-93a4-c30e2d0fcccc None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:15.367551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0203c49-16cc-4dae-93a4-c30e2d0fcccc None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:15.372229 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:15.372840 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.373122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.373396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.374115 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:48:15.374420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:15.376159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:15.389424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1288/2573] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:48:15.394297 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b423afb-e7ce-4d32-b8ca-f431be8f74b9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:15.404622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b423afb-e7ce-4d32-b8ca-f431be8f74b9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:15.409327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5aa69-143a-439e-b633-8e27ecb6499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:15.410004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5aa69-143a-439e-b633-8e27ecb6499f admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.410285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5aa69-143a-439e-b633-8e27ecb6499f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.410556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5aa69-143a-439e-b633-8e27ecb6499f admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.411197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5aa69-143a-439e-b633-8e27ecb6499f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:15.413223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5aa69-143a-439e-b633-8e27ecb6499f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:15.442487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1286/2574] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:15 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:15.446877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:15.457487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3641c-9b9c-4da9-8fcc-cd7547f0afe4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:15.521215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216d4ae-ace7-4bdd-86fa-3634713deb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:15.521875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216d4ae-ace7-4bdd-86fa-3634713deb5b admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.522162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216d4ae-ace7-4bdd-86fa-3634713deb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.522440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216d4ae-ace7-4bdd-86fa-3634713deb5b admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.523592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216d4ae-ace7-4bdd-86fa-3634713deb5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:15.525541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216d4ae-ace7-4bdd-86fa-3634713deb5b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:15.548969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1289/2575] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:15 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:48:15.553310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5aa69-143a-439e-b633-8e27ecb6499f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:15.564989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5aa69-143a-439e-b633-8e27ecb6499f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:15.570203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d6b97-5241-478d-98ce-8502e0c94bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:15.570823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6b97-5241-478d-98ce-8502e0c94bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.571101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6b97-5241-478d-98ce-8502e0c94bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.571379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d6b97-5241-478d-98ce-8502e0c94bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.572030 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d6b97-5241-478d-98ce-8502e0c94bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:15.573697 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d6b97-5241-478d-98ce-8502e0c94bf8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:15.584413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1287/2576] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:15.589070 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216d4ae-ace7-4bdd-86fa-3634713deb5b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:15.599581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216d4ae-ace7-4bdd-86fa-3634713deb5b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:15.604364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f511f9-594a-4c1f-b9dd-c1e2f6f5ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:15.604982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f511f9-594a-4c1f-b9dd-c1e2f6f5ded7 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.605270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f511f9-594a-4c1f-b9dd-c1e2f6f5ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.605587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f511f9-594a-4c1f-b9dd-c1e2f6f5ded7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.606241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f511f9-594a-4c1f-b9dd-c1e2f6f5ded7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:15.607848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f511f9-594a-4c1f-b9dd-c1e2f6f5ded7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:15.613672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:15.620033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1290/2577] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:15.625774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d6b97-5241-478d-98ce-8502e0c94bf8 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:15.636843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d6b97-5241-478d-98ce-8502e0c94bf8 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:15.645360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:15.646061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.646343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.646641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] PATH_INFO: `/v3/projects/1fb8995d840c474696e8f4eb1484bc74/users/16de71d66b7f40688bbde5410e8cee40/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.665657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb8995d840c474696e8f4eb1484bc74, user_id=16de71d66b7f40688bbde5410e8cee40, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:15.668355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:15.685590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1288/2578] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:15 2022] PUT /identity/v3/projects/1fb8995d840c474696e8f4eb1484bc74/users/16de71d66b7f40688bbde5410e8cee40/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:15.694185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa1339-32dd-4945-8e95-ef42b4705a1e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.694185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa1339-32dd-4945-8e95-ef42b4705a1e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.695095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa1339-32dd-4945-8e95-ef42b4705a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.717218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-82fa1339-32dd-4945-8e95-ef42b4705a1e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:15.718484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-82fa1339-32dd-4945-8e95-ef42b4705a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:15.793906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1291/2579] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:15.805784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:15.808143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:15.818769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:15.889493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d314e-3e51-4c3b-ab0a-334c6e1dab99 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:15.894436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:15.895056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:15.895342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:15.895617 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:15.905480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:15.906953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:15.917960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1289/2580] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:48:16.702869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31544-c403-4e0e-9a7c-58e0981ce711 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:16.703444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31544-c403-4e0e-9a7c-58e0981ce711 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:16.703444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31544-c403-4e0e-9a7c-58e0981ce711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:16.743868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-08e31544-c403-4e0e-9a7c-58e0981ce711 None None] MFA Rules not processed for user `16de71d66b7f40688bbde5410e8cee40`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:16.746267 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-08e31544-c403-4e0e-9a7c-58e0981ce711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:16.817416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:16.819376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:16.831572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29322e-cedf-4fcb-9363-556d2a2f5976 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:16.836296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:16.837261 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:16.837639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:16.837996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:16.839885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1292/2581] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:16.840407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:16.846306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e31544-c403-4e0e-9a7c-58e0981ce711 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:16.862799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e31544-c403-4e0e-9a7c-58e0981ce711 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:16.868786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992613aa-8037-4bf7-81ca-b69b10155f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:16.869602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992613aa-8037-4bf7-81ca-b69b10155f61 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:16.870063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992613aa-8037-4bf7-81ca-b69b10155f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:16.870513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992613aa-8037-4bf7-81ca-b69b10155f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:16.871349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992613aa-8037-4bf7-81ca-b69b10155f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:16.873716 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992613aa-8037-4bf7-81ca-b69b10155f61 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:16.909394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1293/2582] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:16 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:16.916888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992613aa-8037-4bf7-81ca-b69b10155f61 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:16.917634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:16.919311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:16.929625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1290/2583] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:48:16.993015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992613aa-8037-4bf7-81ca-b69b10155f61 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:16.998770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fb1fa-9e5f-4b35-83d3-04f48bedeeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:16.999636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb1fa-9e5f-4b35-83d3-04f48bedeeee admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:17.000033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb1fa-9e5f-4b35-83d3-04f48bedeeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:17.000472 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb1fa-9e5f-4b35-83d3-04f48bedeeee admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:17.001189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fb1fa-9e5f-4b35-83d3-04f48bedeeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:17.003388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fb1fa-9e5f-4b35-83d3-04f48bedeeee admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:17.021555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:17.030760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1294/2584] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:16 2022] POST /identity/v3/users => generated 309 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:17.034671 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:17.047026 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258f8e-0e5b-4cd5-814d-a5841f0413d7 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:17.051885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086f55d-8732-44b4-955a-2b75c37ca311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:17.052516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086f55d-8732-44b4-955a-2b75c37ca311 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:17.052797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086f55d-8732-44b4-955a-2b75c37ca311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:17.053070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086f55d-8732-44b4-955a-2b75c37ca311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:17.053799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086f55d-8732-44b4-955a-2b75c37ca311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:17.056022 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086f55d-8732-44b4-955a-2b75c37ca311 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:17.068255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1291/2585] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:48:17.073124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fb1fa-9e5f-4b35-83d3-04f48bedeeee admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:17.084307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fb1fa-9e5f-4b35-83d3-04f48bedeeee admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:17.089976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df22b0-7441-4146-97d1-1efe867aad44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:17.090659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df22b0-7441-4146-97d1-1efe867aad44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:17.090936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df22b0-7441-4146-97d1-1efe867aad44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:17.091211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df22b0-7441-4146-97d1-1efe867aad44 admin admin] PATH_INFO: `/v3/projects/052ca9e71b07464190f038fa93c44462/users/f60eceacc2ac4c758d8cf2730966d620/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:17.107786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df22b0-7441-4146-97d1-1efe867aad44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=052ca9e71b07464190f038fa93c44462, user_id=f60eceacc2ac4c758d8cf2730966d620, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:17.110711 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df22b0-7441-4146-97d1-1efe867aad44 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:17.129959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1295/2586] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:17 2022] PUT /identity/v3/projects/052ca9e71b07464190f038fa93c44462/users/f60eceacc2ac4c758d8cf2730966d620/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:17.134735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086f55d-8732-44b4-955a-2b75c37ca311 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:17.148842 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086f55d-8732-44b4-955a-2b75c37ca311 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:17.217736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a63f3-6f06-48d2-944e-382676a12a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:17.218365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a63f3-6f06-48d2-944e-382676a12a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:17.218641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a63f3-6f06-48d2-944e-382676a12a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:17.218915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a63f3-6f06-48d2-944e-382676a12a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:17.219563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a63f3-6f06-48d2-944e-382676a12a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:17.221169 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a63f3-6f06-48d2-944e-382676a12a06 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:17.233086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1292/2587] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:17.237416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df22b0-7441-4146-97d1-1efe867aad44 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:17.248499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df22b0-7441-4146-97d1-1efe867aad44 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:17.253660 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ff5fd-7bfd-499b-8880-490a380741bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:17.254434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ff5fd-7bfd-499b-8880-490a380741bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:17.254696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ff5fd-7bfd-499b-8880-490a380741bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:17.255053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ff5fd-7bfd-499b-8880-490a380741bc admin admin] PATH_INFO: `/v3/projects/052ca9e71b07464190f038fa93c44462/users/f60eceacc2ac4c758d8cf2730966d620/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:17.258779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ff5fd-7bfd-499b-8880-490a380741bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=052ca9e71b07464190f038fa93c44462, user_id=f60eceacc2ac4c758d8cf2730966d620, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:17.261271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ff5fd-7bfd-499b-8880-490a380741bc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:17.274480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1296/2588] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:17 2022] PUT /identity/v3/projects/052ca9e71b07464190f038fa93c44462/users/f60eceacc2ac4c758d8cf2730966d620/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:18.097882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ef59-03c6-4569-a01b-500417daad0a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:18.098449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ef59-03c6-4569-a01b-500417daad0a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:18.098733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836ef59-03c6-4569-a01b-500417daad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:18.136417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7836ef59-03c6-4569-a01b-500417daad0a None None] MFA Rules not processed for user `f60eceacc2ac4c758d8cf2730966d620`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:18.137724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7836ef59-03c6-4569-a01b-500417daad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:18.169337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:18.270225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1293/2589] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:19.775007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ff5fd-7bfd-499b-8880-490a380741bc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:19.856875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ff5fd-7bfd-499b-8880-490a380741bc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:19.861906 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:19.862567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:19.862844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:19.863262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] PATH_INFO: `/v3/users/16de71d66b7f40688bbde5410e8cee40` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:19.864503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16de71d66b7f40688bbde5410e8cee40)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:19.867024 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:19.940244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16de71d66b7f40688bbde5410e8cee40'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:19.940844 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16de71d66b7f40688bbde5410e8cee40'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:19.955363 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16de71d66b7f40688bbde5410e8cee40'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:19.956138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16de71d66b7f40688bbde5410e8cee40'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:19.971014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16de71d66b7f40688bbde5410e8cee40'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:19.995478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1297/2590] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:19 2022] DELETE /identity/v3/users/16de71d66b7f40688bbde5410e8cee40 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:20.291004 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836ef59-03c6-4569-a01b-500417daad0a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:20.302398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836ef59-03c6-4569-a01b-500417daad0a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:20.389818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:20.390611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:20.390895 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:20.391178 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] PATH_INFO: `/v3/projects/1fb8995d840c474696e8f4eb1484bc74` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:20.392361 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb8995d840c474696e8f4eb1484bc74)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:20.394349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:20.464856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb8995d840c474696e8f4eb1484bc74', 'request_id': 'req-8271323a-2219-4812-bb00-3014751d7c3c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.474943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb8995d840c474696e8f4eb1484bc74', 'request_id': 'req-8271323a-2219-4812-bb00-3014751d7c3c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.486949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb8995d840c474696e8f4eb1484bc74', 'request_id': 'req-8271323a-2219-4812-bb00-3014751d7c3c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.506329 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] The token cache is being invalidate because project 1fb8995d840c474696e8f4eb1484bc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:20.507390 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.508738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.511195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1294/2591] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:20 2022] DELETE /identity/v3/projects/1fb8995d840c474696e8f4eb1484bc74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:20.515389 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:20.516870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:20.530436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83d6d5-30ac-4ff8-8585-f10a76900c68 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:20.571866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:20.594877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:20.595847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:20.596124 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:20.596399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] PATH_INFO: `/v3/users/f60eceacc2ac4c758d8cf2730966d620` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:20.599198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60eceacc2ac4c758d8cf2730966d620)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:20.601384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:20.669184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60eceacc2ac4c758d8cf2730966d620'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.670595 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60eceacc2ac4c758d8cf2730966d620'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.682393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60eceacc2ac4c758d8cf2730966d620'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.683442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60eceacc2ac4c758d8cf2730966d620'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.696584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-21281f76-4f30-48a2-a90d-934afd8ca313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60eceacc2ac4c758d8cf2730966d620'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:20.721225 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1298/2592] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:20 2022] DELETE /identity/v3/users/f60eceacc2ac4c758d8cf2730966d620 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:48:21.003933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:21.006351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:21.026953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271323a-2219-4812-bb00-3014751d7c3c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:21.103301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:21.122333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:21.122333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.122333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.122795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] PATH_INFO: `/v3/projects/052ca9e71b07464190f038fa93c44462` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.123859 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=052ca9e71b07464190f038fa93c44462)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:21.126277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:21.212539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052ca9e71b07464190f038fa93c44462', 'request_id': 'req-5555308f-5f0a-4155-80d1-4f44cba553d2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:21.226684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052ca9e71b07464190f038fa93c44462', 'request_id': 'req-5555308f-5f0a-4155-80d1-4f44cba553d2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:21.235131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052ca9e71b07464190f038fa93c44462', 'request_id': 'req-5555308f-5f0a-4155-80d1-4f44cba553d2'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:21.271357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] The token cache is being invalidate because project 052ca9e71b07464190f038fa93c44462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:21.272023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:21.273710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-5555308f-5f0a-4155-80d1-4f44cba553d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:21.276710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1295/2593] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:21 2022] DELETE /identity/v3/projects/052ca9e71b07464190f038fa93c44462 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:21.283304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbb695-bd3e-40b8-9f49-19dda12cf462 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.283866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbb695-bd3e-40b8-9f49-19dda12cf462 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.283866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbb695-bd3e-40b8-9f49-19dda12cf462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.313172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cabbb695-bd3e-40b8-9f49-19dda12cf462 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:21.314494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cabbb695-bd3e-40b8-9f49-19dda12cf462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:21.394746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1299/2594] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:21.411815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01101809-9fde-468f-8ff0-84c5f52504b2 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.411815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01101809-9fde-468f-8ff0-84c5f52504b2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.411815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01101809-9fde-468f-8ff0-84c5f52504b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.448500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-01101809-9fde-468f-8ff0-84c5f52504b2 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:21.450259 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-01101809-9fde-468f-8ff0-84c5f52504b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:21.464131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1296/2595] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:21.469740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbb695-bd3e-40b8-9f49-19dda12cf462 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:21.489136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbb695-bd3e-40b8-9f49-19dda12cf462 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:21.494561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:21.495350 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.495761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.496140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.496941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:48:21.497353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:21.499213 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:21.514048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1300/2596] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:48:21.521409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01101809-9fde-468f-8ff0-84c5f52504b2 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:21.535039 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01101809-9fde-468f-8ff0-84c5f52504b2 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:21.540849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205da45-16cb-47ee-ba63-170f141ea9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:21.541483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205da45-16cb-47ee-ba63-170f141ea9db admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.541810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205da45-16cb-47ee-ba63-170f141ea9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.542064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205da45-16cb-47ee-ba63-170f141ea9db admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.542712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205da45-16cb-47ee-ba63-170f141ea9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:21.544721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205da45-16cb-47ee-ba63-170f141ea9db admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:21.590964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1297/2597] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:21 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:21.595790 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:21.611480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08841dd1-21b1-467f-a012-9d989a6f4f7e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:21.692706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:21.713838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9d9cd-b153-41e7-8712-1bf9e75c37c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:21.714956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9d9cd-b153-41e7-8712-1bf9e75c37c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.715429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9d9cd-b153-41e7-8712-1bf9e75c37c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.715870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9d9cd-b153-41e7-8712-1bf9e75c37c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.717878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9d9cd-b153-41e7-8712-1bf9e75c37c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:21.722072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9d9cd-b153-41e7-8712-1bf9e75c37c1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:21.769960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1301/2598] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:21 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:48:21.771587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205da45-16cb-47ee-ba63-170f141ea9db admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:21.789419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205da45-16cb-47ee-ba63-170f141ea9db admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:21.794375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb6b2e-6c4e-43d3-81e2-154d9a824a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:21.795034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb6b2e-6c4e-43d3-81e2-154d9a824a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.795312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb6b2e-6c4e-43d3-81e2-154d9a824a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.795621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb6b2e-6c4e-43d3-81e2-154d9a824a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.796279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb6b2e-6c4e-43d3-81e2-154d9a824a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:21.797961 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb6b2e-6c4e-43d3-81e2-154d9a824a7b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:21.809283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1298/2599] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:21.813742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9d9cd-b153-41e7-8712-1bf9e75c37c1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:21.825420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9d9cd-b153-41e7-8712-1bf9e75c37c1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:21.830846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20078b96-3530-4ee7-a245-091948de1f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:21.831489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078b96-3530-4ee7-a245-091948de1f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.831774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078b96-3530-4ee7-a245-091948de1f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.832053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078b96-3530-4ee7-a245-091948de1f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.832722 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20078b96-3530-4ee7-a245-091948de1f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:21.834424 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20078b96-3530-4ee7-a245-091948de1f12 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:21.847200 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1302/2600] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:21.852019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb6b2e-6c4e-43d3-81e2-154d9a824a7b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:21.863153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb6b2e-6c4e-43d3-81e2-154d9a824a7b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:21.868486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d7731-9d0a-4319-9be5-552b1b13626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:21.869197 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d7731-9d0a-4319-9be5-552b1b13626a admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.869482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d7731-9d0a-4319-9be5-552b1b13626a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.869814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d7731-9d0a-4319-9be5-552b1b13626a admin admin] PATH_INFO: `/v3/projects/1f1993b17ee44130a32e0ccbf8f4a213/users/e21633ff486541d5a8f0ded4cc71c924/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.887081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d7731-9d0a-4319-9be5-552b1b13626a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1993b17ee44130a32e0ccbf8f4a213, user_id=e21633ff486541d5a8f0ded4cc71c924, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:21.889885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d7731-9d0a-4319-9be5-552b1b13626a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:21.906695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1299/2601] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:21 2022] PUT /identity/v3/projects/1f1993b17ee44130a32e0ccbf8f4a213/users/e21633ff486541d5a8f0ded4cc71c924/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:48:21.918454 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deac9f-0bfe-443b-adc4-c3b15b64fe5d None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:21.918762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deac9f-0bfe-443b-adc4-c3b15b64fe5d None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:21.919103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13deac9f-0bfe-443b-adc4-c3b15b64fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:21.954741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-13deac9f-0bfe-443b-adc4-c3b15b64fe5d None None] MFA Rules not processed for user `e21633ff486541d5a8f0ded4cc71c924`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:21.956041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-13deac9f-0bfe-443b-adc4-c3b15b64fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:22.028975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1303/2602] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:22.033682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d7731-9d0a-4319-9be5-552b1b13626a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:22.116934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d7731-9d0a-4319-9be5-552b1b13626a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:22.125302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f8bad-3f9b-4839-b548-d6874b00cb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:22.126386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f8bad-3f9b-4839-b548-d6874b00cb7c admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.126831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f8bad-3f9b-4839-b548-d6874b00cb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.127164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f8bad-3f9b-4839-b548-d6874b00cb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.127929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f8bad-3f9b-4839-b548-d6874b00cb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:22.130853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f8bad-3f9b-4839-b548-d6874b00cb7c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:22.155937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:22.166880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1300/2603] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:22 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:22.172390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deac9f-0bfe-443b-adc4-c3b15b64fe5d None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:22.184827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13deac9f-0bfe-443b-adc4-c3b15b64fe5d None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:22.249384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba85e9-4535-40af-9421-2d1745c66c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:22.250042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba85e9-4535-40af-9421-2d1745c66c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.250326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba85e9-4535-40af-9421-2d1745c66c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.250621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba85e9-4535-40af-9421-2d1745c66c39 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.251262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba85e9-4535-40af-9421-2d1745c66c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:22.253308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba85e9-4535-40af-9421-2d1745c66c39 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:22.289282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1304/2604] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:22 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:22.297758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f8bad-3f9b-4839-b548-d6874b00cb7c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:22.311865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f8bad-3f9b-4839-b548-d6874b00cb7c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:22.316305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac09e-395f-495c-9c1e-d1eada11f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:22.316942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac09e-395f-495c-9c1e-d1eada11f22e admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.317219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac09e-395f-495c-9c1e-d1eada11f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.317491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac09e-395f-495c-9c1e-d1eada11f22e admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.318174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ac09e-395f-495c-9c1e-d1eada11f22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:22.320490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ac09e-395f-495c-9c1e-d1eada11f22e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:22.332951 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1301/2605] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:22.337401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba85e9-4535-40af-9421-2d1745c66c39 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:22.348872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba85e9-4535-40af-9421-2d1745c66c39 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:22.354295 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5053-2e10-475c-8cfb-be17816742f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:22.355634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5053-2e10-475c-8cfb-be17816742f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.355634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5053-2e10-475c-8cfb-be17816742f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.355634 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5053-2e10-475c-8cfb-be17816742f5 admin admin] PATH_INFO: `/v3/projects/dd9f3521c8d24796807c6c9a48da4694/users/4be033db516d464b985195d3ebb9aa21/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.375079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f5053-2e10-475c-8cfb-be17816742f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9f3521c8d24796807c6c9a48da4694, user_id=4be033db516d464b985195d3ebb9aa21, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:22.377828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f5053-2e10-475c-8cfb-be17816742f5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:22.402446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1305/2606] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:22 2022] PUT /identity/v3/projects/dd9f3521c8d24796807c6c9a48da4694/users/4be033db516d464b985195d3ebb9aa21/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:22.407519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac09e-395f-495c-9c1e-d1eada11f22e admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:22.421142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac09e-395f-495c-9c1e-d1eada11f22e admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:22.516263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9421613-00fe-4fdf-bb1e-1a76f3c19bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:22.516886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421613-00fe-4fdf-bb1e-1a76f3c19bae admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.517191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421613-00fe-4fdf-bb1e-1a76f3c19bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.517571 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421613-00fe-4fdf-bb1e-1a76f3c19bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.518214 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9421613-00fe-4fdf-bb1e-1a76f3c19bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:22.519924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9421613-00fe-4fdf-bb1e-1a76f3c19bae admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:22.533019 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1302/2607] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:22.540309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5053-2e10-475c-8cfb-be17816742f5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:22.559754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5053-2e10-475c-8cfb-be17816742f5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:22.567973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:22.569242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.569780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.570269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] PATH_INFO: `/v3/projects/dd9f3521c8d24796807c6c9a48da4694/users/4be033db516d464b985195d3ebb9aa21/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.573757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9f3521c8d24796807c6c9a48da4694, user_id=4be033db516d464b985195d3ebb9aa21, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:22.579218 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:22.596827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1306/2608] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:22 2022] PUT /identity/v3/projects/dd9f3521c8d24796807c6c9a48da4694/users/4be033db516d464b985195d3ebb9aa21/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:22.609103 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e545d-1b79-4461-8e45-c446b36b5438 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.609375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e545d-1b79-4461-8e45-c446b36b5438 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.609719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e545d-1b79-4461-8e45-c446b36b5438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.644573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-2b0e545d-1b79-4461-8e45-c446b36b5438 None None] MFA Rules not processed for user `4be033db516d464b985195d3ebb9aa21`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:22.645873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2b0e545d-1b79-4461-8e45-c446b36b5438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:22.748150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1303/2609] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:22.765117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:22.767252 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:22.783312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:22.856363 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e545d-1b79-4461-8e45-c446b36b5438 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:22.857877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-2b0e545d-1b79-4461-8e45-c446b36b5438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:22.877365 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3182b0-ca84-49bb-ba85-a32270afd20f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:22.884419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e308bf-531d-4703-a5bd-1b7a4fc1f468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:22.885475 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e308bf-531d-4703-a5bd-1b7a4fc1f468 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.886052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e308bf-531d-4703-a5bd-1b7a4fc1f468 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.886567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e308bf-531d-4703-a5bd-1b7a4fc1f468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.905096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e308bf-531d-4703-a5bd-1b7a4fc1f468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:22.908053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e308bf-531d-4703-a5bd-1b7a4fc1f468 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:22.923966 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1307/2610] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:48:22.935570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e545d-1b79-4461-8e45-c446b36b5438 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:22.941736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb98082-ea82-466d-877f-8aab62eb4025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:22.942806 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb98082-ea82-466d-877f-8aab62eb4025 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:22.943324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb98082-ea82-466d-877f-8aab62eb4025 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:22.943833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb98082-ea82-466d-877f-8aab62eb4025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:22.947716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-cbb98082-ea82-466d-877f-8aab62eb4025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:22.983828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=100 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:23.033036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb98082-ea82-466d-877f-8aab62eb4025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:23.034638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb98082-ea82-466d-877f-8aab62eb4025 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:23.046883 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1304/2611] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:48:24.597343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e308bf-531d-4703-a5bd-1b7a4fc1f468 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:24.613466 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e308bf-531d-4703-a5bd-1b7a4fc1f468 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:24.619458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:24.620356 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:24.620641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:24.620915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] PATH_INFO: `/v3/users/e21633ff486541d5a8f0ded4cc71c924` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:24.622179 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21633ff486541d5a8f0ded4cc71c924)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:24.624205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:24.722442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21633ff486541d5a8f0ded4cc71c924'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:24.723337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21633ff486541d5a8f0ded4cc71c924'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:24.731993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21633ff486541d5a8f0ded4cc71c924'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:24.732886 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21633ff486541d5a8f0ded4cc71c924'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:24.741260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21633ff486541d5a8f0ded4cc71c924'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:24.762554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1308/2612] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:24 2022] DELETE /identity/v3/users/e21633ff486541d5a8f0ded4cc71c924 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:24.767704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0fec8-5bfc-49e1-866f-22aad616d6dd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:24.768267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0fec8-5bfc-49e1-866f-22aad616d6dd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:24.768267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0fec8-5bfc-49e1-866f-22aad616d6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:24.790533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-43d0fec8-5bfc-49e1-866f-22aad616d6dd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:24.791900 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-43d0fec8-5bfc-49e1-866f-22aad616d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:24.858037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1305/2613] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:24.869583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:24.872487 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:24.941051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29879899-c9ea-4b6e-ab8e-9f057d5d942a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:24.944951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7659c-4c3f-4f7a-bb9f-a96b258129c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:24.945608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7659c-4c3f-4f7a-bb9f-a96b258129c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:24.945894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7659c-4c3f-4f7a-bb9f-a96b258129c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:24.946172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7659c-4c3f-4f7a-bb9f-a96b258129c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:24.956081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7659c-4c3f-4f7a-bb9f-a96b258129c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:24.957557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7659c-4c3f-4f7a-bb9f-a96b258129c8 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:24.968657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1309/2614] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:25.343236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0fec8-5bfc-49e1-866f-22aad616d6dd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:25.344792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-43d0fec8-5bfc-49e1-866f-22aad616d6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:25.358875 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0fec8-5bfc-49e1-866f-22aad616d6dd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:25.364165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:25.364989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:25.365365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:25.365772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] PATH_INFO: `/v3/projects/1f1993b17ee44130a32e0ccbf8f4a213` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:25.367830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1993b17ee44130a32e0ccbf8f4a213)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:25.370156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:25.454945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1993b17ee44130a32e0ccbf8f4a213', 'request_id': 'req-0f079cc4-5939-49a6-917e-6f39a93e9cbb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.466167 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1993b17ee44130a32e0ccbf8f4a213', 'request_id': 'req-0f079cc4-5939-49a6-917e-6f39a93e9cbb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.478886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1993b17ee44130a32e0ccbf8f4a213', 'request_id': 'req-0f079cc4-5939-49a6-917e-6f39a93e9cbb'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.492444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] The token cache is being invalidate because project 1f1993b17ee44130a32e0ccbf8f4a213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:25.492788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.493415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.495216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1306/2615] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:25 2022] DELETE /identity/v3/projects/1f1993b17ee44130a32e0ccbf8f4a213 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:25.499167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7659c-4c3f-4f7a-bb9f-a96b258129c8 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:25.515861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7659c-4c3f-4f7a-bb9f-a96b258129c8 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:25.541373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:25.607361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:25.609591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:25.610107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:25.611409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] PATH_INFO: `/v3/users/4be033db516d464b985195d3ebb9aa21` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:25.613563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be033db516d464b985195d3ebb9aa21)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:25.616082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:25.685594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be033db516d464b985195d3ebb9aa21'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.686528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be033db516d464b985195d3ebb9aa21'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.714275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be033db516d464b985195d3ebb9aa21'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.715256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be033db516d464b985195d3ebb9aa21'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.734141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-61950b00-45e1-4e19-bcc1-f95de46e05a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be033db516d464b985195d3ebb9aa21'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:25.762964 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1310/2616] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:25 2022] DELETE /identity/v3/users/4be033db516d464b985195d3ebb9aa21 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:48:26.344516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:26.346896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:26.367923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f079cc4-5939-49a6-917e-6f39a93e9cbb admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:26.425448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:26.452320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:26.453510 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:26.453829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:26.454123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] PATH_INFO: `/v3/projects/dd9f3521c8d24796807c6c9a48da4694` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:26.455796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9f3521c8d24796807c6c9a48da4694)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:26.458471 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:26.594526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9f3521c8d24796807c6c9a48da4694', 'request_id': 'req-b18508f7-0b84-4367-ac3f-09f11e3599ee'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:26.622486 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9f3521c8d24796807c6c9a48da4694', 'request_id': 'req-b18508f7-0b84-4367-ac3f-09f11e3599ee'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:26.640561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9f3521c8d24796807c6c9a48da4694', 'request_id': 'req-b18508f7-0b84-4367-ac3f-09f11e3599ee'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:26.669599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] The token cache is being invalidate because project dd9f3521c8d24796807c6c9a48da4694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:26.670893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:26.671976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b18508f7-0b84-4367-ac3f-09f11e3599ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:26.674870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1307/2617] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:26 2022] DELETE /identity/v3/projects/dd9f3521c8d24796807c6c9a48da4694 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:26.682165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815228cd-3a00-48d8-a385-6d18ae1b50a4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:26.682813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815228cd-3a00-48d8-a385-6d18ae1b50a4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:26.683200 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815228cd-3a00-48d8-a385-6d18ae1b50a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:26.731737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-815228cd-3a00-48d8-a385-6d18ae1b50a4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:26.733001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-815228cd-3a00-48d8-a385-6d18ae1b50a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:26.836008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1311/2618] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:26.840926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abbf1a-33aa-4a13-9d67-f5e54af882ff None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:26.841217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abbf1a-33aa-4a13-9d67-f5e54af882ff None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:26.841499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abbf1a-33aa-4a13-9d67-f5e54af882ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:26.872234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-67abbf1a-33aa-4a13-9d67-f5e54af882ff None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:26.873879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-67abbf1a-33aa-4a13-9d67-f5e54af882ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:26.884679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1308/2619] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:26.890301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815228cd-3a00-48d8-a385-6d18ae1b50a4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:26.909887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815228cd-3a00-48d8-a385-6d18ae1b50a4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:26.918026 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:26.918943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:26.919374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:26.920636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:26.921757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:48:26.922410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:26.925242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:26.956418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1312/2620] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:48:26.957653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abbf1a-33aa-4a13-9d67-f5e54af882ff None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:26.968226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abbf1a-33aa-4a13-9d67-f5e54af882ff None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:26.975743 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd92f80-ab40-48f2-a3a9-7b4c2f9438df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:26.976773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92f80-ab40-48f2-a3a9-7b4c2f9438df admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:26.977061 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92f80-ab40-48f2-a3a9-7b4c2f9438df admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:26.977370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd92f80-ab40-48f2-a3a9-7b4c2f9438df admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:26.978932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd92f80-ab40-48f2-a3a9-7b4c2f9438df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:26.982192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd92f80-ab40-48f2-a3a9-7b4c2f9438df admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.026404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1309/2621] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:26 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:27.031607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.047121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d60b2-77c3-43f1-837c-daed6394b07b admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:27.088959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:27.135365 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad3cb-7793-444b-bc89-4fa6c348effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:27.136000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad3cb-7793-444b-bc89-4fa6c348effa admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.136277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad3cb-7793-444b-bc89-4fa6c348effa admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.136552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad3cb-7793-444b-bc89-4fa6c348effa admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.137774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ad3cb-7793-444b-bc89-4fa6c348effa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:27.139422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ad3cb-7793-444b-bc89-4fa6c348effa admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.170870 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1313/2622] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:27 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:48:27.174841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd92f80-ab40-48f2-a3a9-7b4c2f9438df admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.197362 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd92f80-ab40-48f2-a3a9-7b4c2f9438df admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:27.209340 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b253c-a503-4d3b-8574-4f3fbfc9cee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:27.210579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b253c-a503-4d3b-8574-4f3fbfc9cee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.210853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b253c-a503-4d3b-8574-4f3fbfc9cee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.211132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b253c-a503-4d3b-8574-4f3fbfc9cee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.211797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b253c-a503-4d3b-8574-4f3fbfc9cee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:27.216938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b253c-a503-4d3b-8574-4f3fbfc9cee7 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.229624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1310/2623] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:27.233256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad3cb-7793-444b-bc89-4fa6c348effa admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.245724 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad3cb-7793-444b-bc89-4fa6c348effa admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:27.254002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe566b-9acd-43b2-9a1b-7741eb8ff490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:27.256133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe566b-9acd-43b2-9a1b-7741eb8ff490 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.257335 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe566b-9acd-43b2-9a1b-7741eb8ff490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.257928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe566b-9acd-43b2-9a1b-7741eb8ff490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.259051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe566b-9acd-43b2-9a1b-7741eb8ff490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:27.260621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe566b-9acd-43b2-9a1b-7741eb8ff490 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.405019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1314/2624] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:27.406979 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b253c-a503-4d3b-8574-4f3fbfc9cee7 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.418104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b253c-a503-4d3b-8574-4f3fbfc9cee7 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:27.424548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6ece-5285-40cb-ab75-53781a2ac805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:27.425120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6ece-5285-40cb-ab75-53781a2ac805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.425402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6ece-5285-40cb-ab75-53781a2ac805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.425726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6ece-5285-40cb-ab75-53781a2ac805 admin admin] PATH_INFO: `/v3/projects/36189f6b81e64d5c9361cf39a0c1a878/users/66ceffef7831469ca489fa9e2dddc5b7/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.442633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6ece-5285-40cb-ab75-53781a2ac805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36189f6b81e64d5c9361cf39a0c1a878, user_id=66ceffef7831469ca489fa9e2dddc5b7, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:27.445684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6ece-5285-40cb-ab75-53781a2ac805 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.461396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1311/2625] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:27 2022] PUT /identity/v3/projects/36189f6b81e64d5c9361cf39a0c1a878/users/66ceffef7831469ca489fa9e2dddc5b7/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:48:27.473021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb85ea-5025-4afe-b3f4-d4852c809966 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.473326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb85ea-5025-4afe-b3f4-d4852c809966 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.473646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb85ea-5025-4afe-b3f4-d4852c809966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.506014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-fcfb85ea-5025-4afe-b3f4-d4852c809966 None None] MFA Rules not processed for user `66ceffef7831469ca489fa9e2dddc5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:27.507502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-fcfb85ea-5025-4afe-b3f4-d4852c809966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:27.606524 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1315/2626] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:27.611502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6ece-5285-40cb-ab75-53781a2ac805 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.691686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6ece-5285-40cb-ab75-53781a2ac805 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:27.697781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed50688-1bbb-4302-80d3-73a6f3753350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:27.698966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed50688-1bbb-4302-80d3-73a6f3753350 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.699393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed50688-1bbb-4302-80d3-73a6f3753350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.699672 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed50688-1bbb-4302-80d3-73a6f3753350 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.700331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed50688-1bbb-4302-80d3-73a6f3753350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:27.702454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed50688-1bbb-4302-80d3-73a6f3753350 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.720222 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:27.743184 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1312/2627] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:27 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:27.747581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb85ea-5025-4afe-b3f4-d4852c809966 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.770211 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb85ea-5025-4afe-b3f4-d4852c809966 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:27.861955 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ad4fa-b03f-4c3e-bbab-5f6ba8e23f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:27.862757 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad4fa-b03f-4c3e-bbab-5f6ba8e23f88 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.863043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad4fa-b03f-4c3e-bbab-5f6ba8e23f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.863322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ad4fa-b03f-4c3e-bbab-5f6ba8e23f88 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.863971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ad4fa-b03f-4c3e-bbab-5f6ba8e23f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:27.866289 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ad4fa-b03f-4c3e-bbab-5f6ba8e23f88 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.895106 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1316/2628] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:27 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:27.900554 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed50688-1bbb-4302-80d3-73a6f3753350 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.913067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed50688-1bbb-4302-80d3-73a6f3753350 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:27.919590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18ffcb-deda-4946-ac8c-1e3135de91f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:27.920213 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ffcb-deda-4946-ac8c-1e3135de91f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.920625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ffcb-deda-4946-ac8c-1e3135de91f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.920966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18ffcb-deda-4946-ac8c-1e3135de91f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.921726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18ffcb-deda-4946-ac8c-1e3135de91f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:27.923462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18ffcb-deda-4946-ac8c-1e3135de91f5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.939033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1313/2629] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:27.943262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ad4fa-b03f-4c3e-bbab-5f6ba8e23f88 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.954166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ad4fa-b03f-4c3e-bbab-5f6ba8e23f88 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:27.959924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a17b53-77e2-4422-8427-cb98abc594ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:27.964733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a17b53-77e2-4422-8427-cb98abc594ed admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:27.964878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a17b53-77e2-4422-8427-cb98abc594ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:27.965079 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a17b53-77e2-4422-8427-cb98abc594ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:27.965794 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a17b53-77e2-4422-8427-cb98abc594ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:27.967422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a17b53-77e2-4422-8427-cb98abc594ed admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:27.979608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1317/2630] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:48:27.984246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18ffcb-deda-4946-ac8c-1e3135de91f5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:27.995840 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18ffcb-deda-4946-ac8c-1e3135de91f5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:28.000921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3f3c1-5621-44d5-bc9c-0f640d64d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:28.001630 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3f3c1-5621-44d5-bc9c-0f640d64d479 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.001921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3f3c1-5621-44d5-bc9c-0f640d64d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.002206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3f3c1-5621-44d5-bc9c-0f640d64d479 admin admin] PATH_INFO: `/v3/projects/289dbe29cb8e4271a3904347fecbf5d8/users/3fe422960ec043a98b58b139dc09bb8b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.018648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3f3c1-5621-44d5-bc9c-0f640d64d479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=289dbe29cb8e4271a3904347fecbf5d8, user_id=3fe422960ec043a98b58b139dc09bb8b, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:28.021642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3f3c1-5621-44d5-bc9c-0f640d64d479 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:28.039461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1314/2631] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:27 2022] PUT /identity/v3/projects/289dbe29cb8e4271a3904347fecbf5d8/users/3fe422960ec043a98b58b139dc09bb8b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:48:28.061722 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754e5f-5204-45b5-9138-8e8fdd282f4e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.062019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754e5f-5204-45b5-9138-8e8fdd282f4e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.062297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49754e5f-5204-45b5-9138-8e8fdd282f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.091200 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-49754e5f-5204-45b5-9138-8e8fdd282f4e None None] MFA Rules not processed for user `3fe422960ec043a98b58b139dc09bb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:28.092415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-49754e5f-5204-45b5-9138-8e8fdd282f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:28.097473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:28.160909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1318/2632] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:28.165484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3f3c1-5621-44d5-bc9c-0f640d64d479 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:28.229462 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3f3c1-5621-44d5-bc9c-0f640d64d479 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:28.234035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29767a6-80ef-4924-9808-2317e682e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:28.234642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29767a6-80ef-4924-9808-2317e682e7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.234924 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29767a6-80ef-4924-9808-2317e682e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.235196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29767a6-80ef-4924-9808-2317e682e7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.235823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29767a6-80ef-4924-9808-2317e682e7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:28.237749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29767a6-80ef-4924-9808-2317e682e7f3 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:28.270410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1315/2633] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:28 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:28.271597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49754e5f-5204-45b5-9138-8e8fdd282f4e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:28.283431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49754e5f-5204-45b5-9138-8e8fdd282f4e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:28.353807 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc521a6-c881-4cd9-a06a-0a855b49240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:28.354438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc521a6-c881-4cd9-a06a-0a855b49240a admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.354841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc521a6-c881-4cd9-a06a-0a855b49240a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.354984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc521a6-c881-4cd9-a06a-0a855b49240a admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.355609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc521a6-c881-4cd9-a06a-0a855b49240a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:28.358134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc521a6-c881-4cd9-a06a-0a855b49240a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:28.386379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1319/2634] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:28 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:48:28.391070 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29767a6-80ef-4924-9808-2317e682e7f3 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:28.403052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29767a6-80ef-4924-9808-2317e682e7f3 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:28.409074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d7cd-e1d1-42a1-8a68-11aac4f970f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:28.409973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d7cd-e1d1-42a1-8a68-11aac4f970f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.411165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d7cd-e1d1-42a1-8a68-11aac4f970f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.411508 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d7cd-e1d1-42a1-8a68-11aac4f970f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.412260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4d7cd-e1d1-42a1-8a68-11aac4f970f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:28.414955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4d7cd-e1d1-42a1-8a68-11aac4f970f4 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:28.432945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1316/2635] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:28.434355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc521a6-c881-4cd9-a06a-0a855b49240a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:28.454827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc521a6-c881-4cd9-a06a-0a855b49240a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:28.471415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9dcc2-b803-4c93-a17e-8c1038ea5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:28.472104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9dcc2-b803-4c93-a17e-8c1038ea5c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.472388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9dcc2-b803-4c93-a17e-8c1038ea5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.472667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9dcc2-b803-4c93-a17e-8c1038ea5c30 admin admin] PATH_INFO: `/v3/projects/cc6f6de1dfef4489854d2bfed75df288/users/cfa550eb57424e73870e83107a2aad0d/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.503650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9dcc2-b803-4c93-a17e-8c1038ea5c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6f6de1dfef4489854d2bfed75df288, user_id=cfa550eb57424e73870e83107a2aad0d, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:28.506770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9dcc2-b803-4c93-a17e-8c1038ea5c30 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:28.535682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1320/2636] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:28 2022] PUT /identity/v3/projects/cc6f6de1dfef4489854d2bfed75df288/users/cfa550eb57424e73870e83107a2aad0d/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:28.540491 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d7cd-e1d1-42a1-8a68-11aac4f970f4 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:28.560466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d7cd-e1d1-42a1-8a68-11aac4f970f4 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:28.653177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba80f9c-f5ad-43fd-80b3-b95ec3837c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:28.653852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba80f9c-f5ad-43fd-80b3-b95ec3837c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.654137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba80f9c-f5ad-43fd-80b3-b95ec3837c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.654414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba80f9c-f5ad-43fd-80b3-b95ec3837c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.655093 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba80f9c-f5ad-43fd-80b3-b95ec3837c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:28.656750 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba80f9c-f5ad-43fd-80b3-b95ec3837c5e admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:28.668652 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1317/2637] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:28.672996 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9dcc2-b803-4c93-a17e-8c1038ea5c30 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:28.684885 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9dcc2-b803-4c93-a17e-8c1038ea5c30 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:28.695036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:28.695776 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.696061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.696338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] PATH_INFO: `/v3/projects/cc6f6de1dfef4489854d2bfed75df288/users/cfa550eb57424e73870e83107a2aad0d/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.698521 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6f6de1dfef4489854d2bfed75df288, user_id=cfa550eb57424e73870e83107a2aad0d, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:28.701222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:28.713874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1321/2638] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:28 2022] PUT /identity/v3/projects/cc6f6de1dfef4489854d2bfed75df288/users/cfa550eb57424e73870e83107a2aad0d/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:28.724569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1db39-5a3e-464a-a286-9b9e252e8a2a None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.724831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1db39-5a3e-464a-a286-9b9e252e8a2a None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.725260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1db39-5a3e-464a-a286-9b9e252e8a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.756196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-60a1db39-5a3e-464a-a286-9b9e252e8a2a None None] MFA Rules not processed for user `cfa550eb57424e73870e83107a2aad0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:28.757992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-60a1db39-5a3e-464a-a286-9b9e252e8a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:28.778779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:28.837370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1318/2639] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:28.850283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:28.852405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:28.923309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7dd3-b5dd-470e-b584-f135c56b9f18 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:28.927183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304648a5-21c7-4e31-9c38-15f45bf1ddfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:28.927950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304648a5-21c7-4e31-9c38-15f45bf1ddfe service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:28.928122 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304648a5-21c7-4e31-9c38-15f45bf1ddfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:28.928986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304648a5-21c7-4e31-9c38-15f45bf1ddfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:28.942681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:29.005676 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304648a5-21c7-4e31-9c38-15f45bf1ddfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:29.007873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304648a5-21c7-4e31-9c38-15f45bf1ddfe service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:29.022234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1322/2640] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:30.621300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1db39-5a3e-464a-a286-9b9e252e8a2a None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:30.623689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-60a1db39-5a3e-464a-a286-9b9e252e8a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:30.642879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1db39-5a3e-464a-a286-9b9e252e8a2a None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:30.648907 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:30.649950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:30.649950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:30.650527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:30.815609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:30.817091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:30.828927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1319/2641] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:31.818183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304648a5-21c7-4e31-9c38-15f45bf1ddfe service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:31.830185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304648a5-21c7-4e31-9c38-15f45bf1ddfe service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:31.835546 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f60ce-c53a-4b69-a2bb-b8615671a03e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:31.836562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f60ce-c53a-4b69-a2bb-b8615671a03e service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:31.837036 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f60ce-c53a-4b69-a2bb-b8615671a03e service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:31.837502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f60ce-c53a-4b69-a2bb-b8615671a03e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:31.850303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f60ce-c53a-4b69-a2bb-b8615671a03e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:31.852502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f60ce-c53a-4b69-a2bb-b8615671a03e service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:31.878006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1323/2642] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:32.707965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:32.709621 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:32.822702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af340-ebab-4d92-825b-8118816f770d service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:32.829969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:32.830948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:32.831419 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:32.831847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] PATH_INFO: `/v3/users/7498ac0161a947b18557931a6dd042d5` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:32.833246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7498ac0161a947b18557931a6dd042d5)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:32.836032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:32.908566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7498ac0161a947b18557931a6dd042d5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:32.918065 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7498ac0161a947b18557931a6dd042d5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:32.919105 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7498ac0161a947b18557931a6dd042d5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:32.919641 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7498ac0161a947b18557931a6dd042d5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:32.922147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:32.931910 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7498ac0161a947b18557931a6dd042d5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:32.961634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1320/2643] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:32 2022] DELETE /identity/v3/users/7498ac0161a947b18557931a6dd042d5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:33.183150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f60ce-c53a-4b69-a2bb-b8615671a03e service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:33.206877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f60ce-c53a-4b69-a2bb-b8615671a03e service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:33.301045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:33.301726 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:33.302043 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:33.302321 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] PATH_INFO: `/v3/projects/de571cedb2a146c5966def59c12d8f6d` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:33.303917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de571cedb2a146c5966def59c12d8f6d)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:33.305744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:33.381696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de571cedb2a146c5966def59c12d8f6d', 'request_id': 'req-13017e82-be79-4f33-9ab9-5657f219c1f0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.394965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de571cedb2a146c5966def59c12d8f6d', 'request_id': 'req-13017e82-be79-4f33-9ab9-5657f219c1f0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.404973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de571cedb2a146c5966def59c12d8f6d', 'request_id': 'req-13017e82-be79-4f33-9ab9-5657f219c1f0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.425703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] The token cache is being invalidate because project de571cedb2a146c5966def59c12d8f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:33.425936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.426626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.428827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1324/2644] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:33 2022] DELETE /identity/v3/projects/de571cedb2a146c5966def59c12d8f6d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:33.434088 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:33.435733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:33.454477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390cfe9-ac8b-460b-adc4-d33bc58ba7ea admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:33.524234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:33.525151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:33.525435 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:33.525753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] PATH_INFO: `/v3/users/70218f468eaa45518541d79151d00b2d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:33.527012 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70218f468eaa45518541d79151d00b2d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:33.528827 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:33.585962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70218f468eaa45518541d79151d00b2d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.594555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70218f468eaa45518541d79151d00b2d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.595392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70218f468eaa45518541d79151d00b2d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.596256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70218f468eaa45518541d79151d00b2d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.614702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70218f468eaa45518541d79151d00b2d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:33.646779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1321/2645] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:33 2022] DELETE /identity/v3/users/70218f468eaa45518541d79151d00b2d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:33.837051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:33.838801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:33.853203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13017e82-be79-4f33-9ab9-5657f219c1f0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:33.888921 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:33.922765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:33.923646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:33.924116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:33.924560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] PATH_INFO: `/v3/projects/0fd37b2cad2c47a4ada0a7cfa3c49116` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:33.926520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd37b2cad2c47a4ada0a7cfa3c49116)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:33.929048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:33.997020 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd37b2cad2c47a4ada0a7cfa3c49116', 'request_id': 'req-b537e37a-43a8-48d7-906b-55c87b17f606'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:34.008558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd37b2cad2c47a4ada0a7cfa3c49116', 'request_id': 'req-b537e37a-43a8-48d7-906b-55c87b17f606'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:34.020730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd37b2cad2c47a4ada0a7cfa3c49116', 'request_id': 'req-b537e37a-43a8-48d7-906b-55c87b17f606'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:34.034577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] The token cache is being invalidate because project 0fd37b2cad2c47a4ada0a7cfa3c49116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:34.036288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:34.036983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-b537e37a-43a8-48d7-906b-55c87b17f606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:34.042137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1325/2646] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:33 2022] DELETE /identity/v3/projects/0fd37b2cad2c47a4ada0a7cfa3c49116 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:36.171493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:36.173228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:36.188020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb49fb-f1a7-422e-8635-3cf6283c8397 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:36.244504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:36.257854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:36.258922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:36.259223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:36.260002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] PATH_INFO: `/v3/users/66ceffef7831469ca489fa9e2dddc5b7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:36.260843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ceffef7831469ca489fa9e2dddc5b7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:36.262829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:36.322043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ceffef7831469ca489fa9e2dddc5b7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.331535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ceffef7831469ca489fa9e2dddc5b7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.332231 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ceffef7831469ca489fa9e2dddc5b7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.332872 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ceffef7831469ca489fa9e2dddc5b7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.341933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ceffef7831469ca489fa9e2dddc5b7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.362100 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1322/2647] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:36 2022] DELETE /identity/v3/users/66ceffef7831469ca489fa9e2dddc5b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:36.366990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eaef7-464d-476c-8dd6-751e5e16070b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:36.367456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eaef7-464d-476c-8dd6-751e5e16070b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:36.367555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eaef7-464d-476c-8dd6-751e5e16070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:36.390418 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-741eaef7-464d-476c-8dd6-751e5e16070b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:36.392023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-741eaef7-464d-476c-8dd6-751e5e16070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:36.456892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1326/2648] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:36.467791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:36.469365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:36.530017 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166f877-00b8-40ab-9815-f43a790f331b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:36.533703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3ebc-4ea8-4354-a8eb-23f0d966e47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:36.534316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3ebc-4ea8-4354-a8eb-23f0d966e47e service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:36.534599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3ebc-4ea8-4354-a8eb-23f0d966e47e service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:36.534884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a3ebc-4ea8-4354-a8eb-23f0d966e47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:36.544392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3ebc-4ea8-4354-a8eb-23f0d966e47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:36.545964 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a3ebc-4ea8-4354-a8eb-23f0d966e47e service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:36.556381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1323/2649] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:36.853630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eaef7-464d-476c-8dd6-751e5e16070b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:36.855301 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-741eaef7-464d-476c-8dd6-751e5e16070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:36.870734 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eaef7-464d-476c-8dd6-751e5e16070b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:36.875670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:36.876324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:36.876612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:36.876894 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] PATH_INFO: `/v3/projects/36189f6b81e64d5c9361cf39a0c1a878` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:36.878095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36189f6b81e64d5c9361cf39a0c1a878)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:36.880031 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:36.939935 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36189f6b81e64d5c9361cf39a0c1a878', 'request_id': 'req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.948048 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36189f6b81e64d5c9361cf39a0c1a878', 'request_id': 'req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.949235 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:36.957285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36189f6b81e64d5c9361cf39a0c1a878', 'request_id': 'req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.970823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] The token cache is being invalidate because project 36189f6b81e64d5c9361cf39a0c1a878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:36.971255 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.971944 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:36.973627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1327/2650] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:36 2022] DELETE /identity/v3/projects/36189f6b81e64d5c9361cf39a0c1a878 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:36.978291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3ebc-4ea8-4354-a8eb-23f0d966e47e service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:36.989394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a3ebc-4ea8-4354-a8eb-23f0d966e47e service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:37.049638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:37.050285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:37.050567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:37.050843 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] PATH_INFO: `/v3/users/3fe422960ec043a98b58b139dc09bb8b` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:37.051976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe422960ec043a98b58b139dc09bb8b)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:37.054049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:37.070702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:37.110118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe422960ec043a98b58b139dc09bb8b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.117140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe422960ec043a98b58b139dc09bb8b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.117870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe422960ec043a98b58b139dc09bb8b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.118474 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe422960ec043a98b58b139dc09bb8b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.125989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe422960ec043a98b58b139dc09bb8b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.148392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1324/2651] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:36 2022] DELETE /identity/v3/users/3fe422960ec043a98b58b139dc09bb8b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:37.482440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:37.482440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:37.494518 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9106cd2-3e47-4fb1-ac36-92bf9b48bad0 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:37.556959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:37.557706 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:37.557992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:37.558282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] PATH_INFO: `/v3/projects/289dbe29cb8e4271a3904347fecbf5d8` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:37.559461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] RBAC: Authorizing `identity:delete_project(project_id=289dbe29cb8e4271a3904347fecbf5d8)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:37.561360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:37.608950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289dbe29cb8e4271a3904347fecbf5d8', 'request_id': 'req-c16e78f9-80ab-46a4-b112-f9116392298d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.617654 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289dbe29cb8e4271a3904347fecbf5d8', 'request_id': 'req-c16e78f9-80ab-46a4-b112-f9116392298d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.624603 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289dbe29cb8e4271a3904347fecbf5d8', 'request_id': 'req-c16e78f9-80ab-46a4-b112-f9116392298d'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.635854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] The token cache is being invalidate because project 289dbe29cb8e4271a3904347fecbf5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:37.636148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.636799 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.638339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1328/2652] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:37 2022] DELETE /identity/v3/projects/289dbe29cb8e4271a3904347fecbf5d8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:37.642490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:37.643928 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:37.658150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa635f0c-0ce7-4258-af10-87166e81aed3 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:37.720896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:37.721563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:37.721849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:37.722129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] PATH_INFO: `/v3/users/cfa550eb57424e73870e83107a2aad0d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:37.723267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa550eb57424e73870e83107a2aad0d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:37.725206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:37.775374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa550eb57424e73870e83107a2aad0d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.782546 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa550eb57424e73870e83107a2aad0d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.783267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa550eb57424e73870e83107a2aad0d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.783925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa550eb57424e73870e83107a2aad0d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.791825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-2dafa8de-fc42-4d9b-b48b-5b01b16b4c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa550eb57424e73870e83107a2aad0d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:37.810863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1325/2653] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:37 2022] DELETE /identity/v3/users/cfa550eb57424e73870e83107a2aad0d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:38.233486 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:38.235081 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:38.249050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e78f9-80ab-46a4-b112-f9116392298d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:38.314956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:38.315596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.315881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.316162 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] PATH_INFO: `/v3/projects/cc6f6de1dfef4489854d2bfed75df288` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.317288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc6f6de1dfef4489854d2bfed75df288)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:38.319261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:38.335817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:38.366336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc6f6de1dfef4489854d2bfed75df288', 'request_id': 'req-66a3549e-1260-4c0b-8883-a4e637a41ffb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:38.374352 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc6f6de1dfef4489854d2bfed75df288', 'request_id': 'req-66a3549e-1260-4c0b-8883-a4e637a41ffb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:38.380561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc6f6de1dfef4489854d2bfed75df288', 'request_id': 'req-66a3549e-1260-4c0b-8883-a4e637a41ffb'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:38.391775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] The token cache is being invalidate because project cc6f6de1dfef4489854d2bfed75df288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:38.392065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:38.392723 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-66a3549e-1260-4c0b-8883-a4e637a41ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:38.394234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1329/2654] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:38 2022] DELETE /identity/v3/projects/cc6f6de1dfef4489854d2bfed75df288 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:38.399901 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d3d2a-c68d-4c5d-b02e-59a64b6f0615 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.400190 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d3d2a-c68d-4c5d-b02e-59a64b6f0615 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.400468 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d3d2a-c68d-4c5d-b02e-59a64b6f0615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.420448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-ac2d3d2a-c68d-4c5d-b02e-59a64b6f0615 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:38.421691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ac2d3d2a-c68d-4c5d-b02e-59a64b6f0615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:38.430551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:38.483714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1326/2655] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:38.490945 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d997-9d5a-4748-b60a-00d1651a0f79 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.491673 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d997-9d5a-4748-b60a-00d1651a0f79 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.492015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d997-9d5a-4748-b60a-00d1651a0f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.514166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-cd45d997-9d5a-4748-b60a-00d1651a0f79 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:38.515386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cd45d997-9d5a-4748-b60a-00d1651a0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:38.523918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1330/2656] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:38.529657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d3d2a-c68d-4c5d-b02e-59a64b6f0615 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:38.540579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d3d2a-c68d-4c5d-b02e-59a64b6f0615 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:38.545143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:38.545800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.546080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.546353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.546989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:48:38.547294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:38.548920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:38.560948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1327/2657] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:48:38.565245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45d997-9d5a-4748-b60a-00d1651a0f79 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:38.575573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45d997-9d5a-4748-b60a-00d1651a0f79 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:38.580599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea36ca-4e4c-4850-ab0f-34f4fb27cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:38.581485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea36ca-4e4c-4850-ab0f-34f4fb27cef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.581803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea36ca-4e4c-4850-ab0f-34f4fb27cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.582077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea36ca-4e4c-4850-ab0f-34f4fb27cef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.582743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea36ca-4e4c-4850-ab0f-34f4fb27cef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:38.585188 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea36ca-4e4c-4850-ab0f-34f4fb27cef4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:38.614091 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1331/2658] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:38 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:48:38.618392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:38.628302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e483581-8876-4fef-afa2-c914b02a2631 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:38.687080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed8da9-8c94-4dae-951b-8510e6cf6810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:38.687898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed8da9-8c94-4dae-951b-8510e6cf6810 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.688048 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed8da9-8c94-4dae-951b-8510e6cf6810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.688229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed8da9-8c94-4dae-951b-8510e6cf6810 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.688882 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed8da9-8c94-4dae-951b-8510e6cf6810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:38.690838 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed8da9-8c94-4dae-951b-8510e6cf6810 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:38.713649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1328/2659] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:38 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:38.717774 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea36ca-4e4c-4850-ab0f-34f4fb27cef4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:38.728555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea36ca-4e4c-4850-ab0f-34f4fb27cef4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:38.733207 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507b8f3-6202-4e0a-a91a-dbb63b224a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:38.733837 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b8f3-6202-4e0a-a91a-dbb63b224a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.734120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b8f3-6202-4e0a-a91a-dbb63b224a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.734394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507b8f3-6202-4e0a-a91a-dbb63b224a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.735033 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507b8f3-6202-4e0a-a91a-dbb63b224a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:38.736609 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507b8f3-6202-4e0a-a91a-dbb63b224a73 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:38.746442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1332/2660] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:38.750379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed8da9-8c94-4dae-951b-8510e6cf6810 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:38.760764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed8da9-8c94-4dae-951b-8510e6cf6810 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:38.765478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabec2f-1421-4abb-97ed-5d5f5389570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:38.766111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabec2f-1421-4abb-97ed-5d5f5389570c admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.766393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabec2f-1421-4abb-97ed-5d5f5389570c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.766670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabec2f-1421-4abb-97ed-5d5f5389570c admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.767318 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabec2f-1421-4abb-97ed-5d5f5389570c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:38.768960 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabec2f-1421-4abb-97ed-5d5f5389570c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:38.780192 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1329/2661] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:38.784342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507b8f3-6202-4e0a-a91a-dbb63b224a73 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:38.794926 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507b8f3-6202-4e0a-a91a-dbb63b224a73 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:38.799629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:38.800374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.800650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.800922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] PATH_INFO: `/v3/projects/43dda7993c134a1cbf43ca9cf07ed8c8/users/c7971ebbb81f4d588bb6ff2f13b801a1/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.815322 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dda7993c134a1cbf43ca9cf07ed8c8, user_id=c7971ebbb81f4d588bb6ff2f13b801a1, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:38.817948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:38.831330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1333/2662] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:38 2022] PUT /identity/v3/projects/43dda7993c134a1cbf43ca9cf07ed8c8/users/c7971ebbb81f4d588bb6ff2f13b801a1/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:38.842871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eda14-b2b4-4ad1-9e8b-c6a0bf2810d8 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:38.843154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eda14-b2b4-4ad1-9e8b-c6a0bf2810d8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:38.843426 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eda14-b2b4-4ad1-9e8b-c6a0bf2810d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:38.871519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-693eda14-b2b4-4ad1-9e8b-c6a0bf2810d8 None None] MFA Rules not processed for user `c7971ebbb81f4d588bb6ff2f13b801a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:38.872724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-693eda14-b2b4-4ad1-9e8b-c6a0bf2810d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:38.937547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1330/2663] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:38.949493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:38.951238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:39.007432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1374373-1dd8-41db-8dbc-1dd18db55a51 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:39.011283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:39.011889 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:39.012172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:39.012452 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:39.020693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:39.022791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:39.032044 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1334/2664] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:41.473500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c193a5-1bc3-4a06-83fd-a4d9d4adbd54 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:41.474024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c193a5-1bc3-4a06-83fd-a4d9d4adbd54 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:41.474151 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c193a5-1bc3-4a06-83fd-a4d9d4adbd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:41.493662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-77c193a5-1bc3-4a06-83fd-a4d9d4adbd54 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:41.494877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-77c193a5-1bc3-4a06-83fd-a4d9d4adbd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:41.499221 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:41.556732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1331/2665] 10.222.0.17 () {58 vars in 967 bytes} [Mon Oct 3 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:41.599072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:41.601467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:41.655860 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:41.680599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bae0b8-6697-4139-b783-4840c117eddf service glance] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:41.685682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036155c1-3661-46ff-8325-cf93862c9eac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:41.686331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036155c1-3661-46ff-8325-cf93862c9eac service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:41.686625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036155c1-3661-46ff-8325-cf93862c9eac service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:41.686888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036155c1-3661-46ff-8325-cf93862c9eac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:41.697045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036155c1-3661-46ff-8325-cf93862c9eac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:41.698698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036155c1-3661-46ff-8325-cf93862c9eac service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:41.708185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1335/2666] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:48:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:48:43.372997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566bf3e-5825-4710-b3a2-1af9d0d4c045 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:43.373494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566bf3e-5825-4710-b3a2-1af9d0d4c045 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:43.374772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566bf3e-5825-4710-b3a2-1af9d0d4c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:43.399899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-0566bf3e-5825-4710-b3a2-1af9d0d4c045 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:43.401134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0566bf3e-5825-4710-b3a2-1af9d0d4c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:43.409077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1332/2667] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:43.421339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036155c1-3661-46ff-8325-cf93862c9eac service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:43.432826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036155c1-3661-46ff-8325-cf93862c9eac service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:43.438150 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:43.438779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:43.439415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:43.439704 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:43.449333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:43.450938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:43.459769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1336/2668] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:48:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 03 12:48:51.899742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566bf3e-5825-4710-b3a2-1af9d0d4c045 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:51.903298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-0566bf3e-5825-4710-b3a2-1af9d0d4c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:51.997556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566bf3e-5825-4710-b3a2-1af9d0d4c045 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:52.002488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:52.003164 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:52.003443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:52.003718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] PATH_INFO: `/v3/users/7082356593d047a1ad4ff7821c59ed72` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:52.004993 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7082356593d047a1ad4ff7821c59ed72)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:52.007195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:52.011833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:52.014002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:52.069505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7082356593d047a1ad4ff7821c59ed72'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.078211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7082356593d047a1ad4ff7821c59ed72'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.079343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7082356593d047a1ad4ff7821c59ed72'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.080494 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7082356593d047a1ad4ff7821c59ed72'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.091441 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519cb0-9442-483d-9649-234f73b02452 service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:52.091923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7082356593d047a1ad4ff7821c59ed72'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.096595 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:52.097657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:52.098274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:52.098768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:52.102169 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:52.113224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1333/2669] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:51 2022] DELETE /identity/v3/users/7082356593d047a1ad4ff7821c59ed72 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:52.117480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:52.119022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:52.131818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1337/2670] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:48:52.412209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:52.415011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:52.458909 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:52.511997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95c104-39ca-4e20-9d45-e703d3cb77f7 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:52.518464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:52.519738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:52.520138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:52.520519 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] PATH_INFO: `/v3/projects/9b01de50206d4b40ae807acaab320209` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:52.521898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b01de50206d4b40ae807acaab320209)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:52.524046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:52.605502 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b01de50206d4b40ae807acaab320209', 'request_id': 'req-a031e3f6-6a46-44f5-a435-e085a6b0ee52'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.616239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b01de50206d4b40ae807acaab320209', 'request_id': 'req-a031e3f6-6a46-44f5-a435-e085a6b0ee52'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.625853 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b01de50206d4b40ae807acaab320209', 'request_id': 'req-a031e3f6-6a46-44f5-a435-e085a6b0ee52'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.641673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] The token cache is being invalidate because project 9b01de50206d4b40ae807acaab320209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:52.641818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.643837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.646570 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1334/2671] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:52 2022] DELETE /identity/v3/projects/9b01de50206d4b40ae807acaab320209 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:52.650390 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:52.666345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a8bd-889f-4e5c-a8e3-27a16c24e807 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:52.751136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:52.751873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:52.752240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:52.752583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] PATH_INFO: `/v3/users/e535e92b842949ec86f96b791ef9f489` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:52.758938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e535e92b842949ec86f96b791ef9f489)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:52.760657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:52.832824 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e535e92b842949ec86f96b791ef9f489'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.834294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e535e92b842949ec86f96b791ef9f489'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.846743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e535e92b842949ec86f96b791ef9f489'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.847972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e535e92b842949ec86f96b791ef9f489'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.861010 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e535e92b842949ec86f96b791ef9f489'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:52.863527 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:52.889575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1338/2672] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:52 2022] DELETE /identity/v3/users/e535e92b842949ec86f96b791ef9f489 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:48:53.232050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:53.234162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:53.251043 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031e3f6-6a46-44f5-a435-e085a6b0ee52 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:53.330986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:53.332662 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:53.333150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:53.334067 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] PATH_INFO: `/v3/projects/b4060a4d2e304328b0198ddb37dd1d28` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:53.335227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4060a4d2e304328b0198ddb37dd1d28)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:53.337650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:53.430514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4060a4d2e304328b0198ddb37dd1d28', 'request_id': 'req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:53.441816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4060a4d2e304328b0198ddb37dd1d28', 'request_id': 'req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:53.444934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:53.455454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4060a4d2e304328b0198ddb37dd1d28', 'request_id': 'req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:53.472171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] The token cache is being invalidate because project b4060a4d2e304328b0198ddb37dd1d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:53.472805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:53.473847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:53.476821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1335/2673] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:53 2022] DELETE /identity/v3/projects/b4060a4d2e304328b0198ddb37dd1d28 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:56.117379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:56.119480 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:56.141241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967bfaa-ec48-42ef-87df-568a9b6db90e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:56.226260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:56.227125 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:56.227465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:56.227745 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] PATH_INFO: `/v3/users/c29ecb6ed0f5439482957c4365aea4fc` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:56.228903 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29ecb6ed0f5439482957c4365aea4fc)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:56.231250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:56.288366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29ecb6ed0f5439482957c4365aea4fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.289145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29ecb6ed0f5439482957c4365aea4fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.303239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29ecb6ed0f5439482957c4365aea4fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.304103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29ecb6ed0f5439482957c4365aea4fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.315394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-278918a4-5f32-48eb-b841-37ad0226a9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29ecb6ed0f5439482957c4365aea4fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.342423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1339/2674] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:48:56 2022] DELETE /identity/v3/users/c29ecb6ed0f5439482957c4365aea4fc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:56.578228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:56.580524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:56.602868 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506c97e-dfd2-4d36-8773-18c4f5a6a32c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:56.706728 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:56.707663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:56.708183 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:56.708552 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] PATH_INFO: `/v3/projects/3ee4310348eb43768284027e15e5d396` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:56.709766 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee4310348eb43768284027e15e5d396)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:56.711822 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:56.767524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee4310348eb43768284027e15e5d396', 'request_id': 'req-812076b2-b644-4e92-b25e-b8e4c501f15d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.776147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee4310348eb43768284027e15e5d396', 'request_id': 'req-812076b2-b644-4e92-b25e-b8e4c501f15d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.791371 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee4310348eb43768284027e15e5d396', 'request_id': 'req-812076b2-b644-4e92-b25e-b8e4c501f15d'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.812977 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] The token cache is being invalidate because project 3ee4310348eb43768284027e15e5d396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:48:56.813266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.815906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-812076b2-b644-4e92-b25e-b8e4c501f15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:48:56.821945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1336/2675] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:48:56 2022] DELETE /identity/v3/projects/3ee4310348eb43768284027e15e5d396 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:56.823893 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d4b6-11b7-4ecf-9c4e-c2a6e3b50c6c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:56.824299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d4b6-11b7-4ecf-9c4e-c2a6e3b50c6c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:56.824583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d4b6-11b7-4ecf-9c4e-c2a6e3b50c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:56.853345 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-59f7d4b6-11b7-4ecf-9c4e-c2a6e3b50c6c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:56.854648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-59f7d4b6-11b7-4ecf-9c4e-c2a6e3b50c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:56.930698 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1340/2676] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:56.938674 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec572d3-2372-46e7-b139-2ff060495c3d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:56.939040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec572d3-2372-46e7-b139-2ff060495c3d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:56.939395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec572d3-2372-46e7-b139-2ff060495c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:56.961955 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-dec572d3-2372-46e7-b139-2ff060495c3d None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:56.963360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-dec572d3-2372-46e7-b139-2ff060495c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:56.984283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1337/2677] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:56.988361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7d4b6-11b7-4ecf-9c4e-c2a6e3b50c6c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:56.994710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:57.001083 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7d4b6-11b7-4ecf-9c4e-c2a6e3b50c6c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.030220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.030928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.031446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.031801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.032699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:48:57.033073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.034956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.049490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1341/2678] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:48:57.054265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec572d3-2372-46e7-b139-2ff060495c3d None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.064171 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec572d3-2372-46e7-b139-2ff060495c3d None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.069747 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd962c-8b6c-4329-a41b-0b2e06a058be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.070358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd962c-8b6c-4329-a41b-0b2e06a058be admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.070647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd962c-8b6c-4329-a41b-0b2e06a058be admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.070923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd962c-8b6c-4329-a41b-0b2e06a058be admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.071572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd962c-8b6c-4329-a41b-0b2e06a058be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.073647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd962c-8b6c-4329-a41b-0b2e06a058be admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.114385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1338/2679] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:57 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:48:57.118349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.130433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbf8e2-8bf1-40c5-8e2f-039c7964d2d8 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.203464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ef39-8081-49bb-be2e-56f0b11df440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.204116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ef39-8081-49bb-be2e-56f0b11df440 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.204394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ef39-8081-49bb-be2e-56f0b11df440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.204667 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500ef39-8081-49bb-be2e-56f0b11df440 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.205307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500ef39-8081-49bb-be2e-56f0b11df440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.207274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500ef39-8081-49bb-be2e-56f0b11df440 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.238630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1342/2680] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:57 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:57.240348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd962c-8b6c-4329-a41b-0b2e06a058be admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.263465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd962c-8b6c-4329-a41b-0b2e06a058be admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.268525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c0bc8-1bab-4ac6-8ae4-83be75530410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.269124 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0bc8-1bab-4ac6-8ae4-83be75530410 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.269366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0bc8-1bab-4ac6-8ae4-83be75530410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.269773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c0bc8-1bab-4ac6-8ae4-83be75530410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.270331 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c0bc8-1bab-4ac6-8ae4-83be75530410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.272488 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c0bc8-1bab-4ac6-8ae4-83be75530410 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.283590 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1339/2681] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:48:57.288358 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ef39-8081-49bb-be2e-56f0b11df440 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.299196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500ef39-8081-49bb-be2e-56f0b11df440 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.303970 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82fa5e-ae99-488f-a9c5-8bf655b98d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.304575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82fa5e-ae99-488f-a9c5-8bf655b98d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.304855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82fa5e-ae99-488f-a9c5-8bf655b98d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.305131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82fa5e-ae99-488f-a9c5-8bf655b98d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.305817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82fa5e-ae99-488f-a9c5-8bf655b98d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.307407 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82fa5e-ae99-488f-a9c5-8bf655b98d2a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.319612 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1343/2682] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:57.324345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c0bc8-1bab-4ac6-8ae4-83be75530410 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.335656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c0bc8-1bab-4ac6-8ae4-83be75530410 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.340694 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe586-cd74-4339-8337-e9660aab297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.341429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe586-cd74-4339-8337-e9660aab297b admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.341745 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe586-cd74-4339-8337-e9660aab297b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.342025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfe586-cd74-4339-8337-e9660aab297b admin admin] PATH_INFO: `/v3/projects/2fe602611f6b44fd89cc6555bfa5682d/users/f898ebe5fd924cd3b2b5e07df319ee69/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.360132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfe586-cd74-4339-8337-e9660aab297b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe602611f6b44fd89cc6555bfa5682d, user_id=f898ebe5fd924cd3b2b5e07df319ee69, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.362874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfe586-cd74-4339-8337-e9660aab297b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.382563 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1340/2683] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:57 2022] PUT /identity/v3/projects/2fe602611f6b44fd89cc6555bfa5682d/users/f898ebe5fd924cd3b2b5e07df319ee69/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:57.394541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f876d6-fac4-457d-bef2-a77fb7fda639 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.394951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f876d6-fac4-457d-bef2-a77fb7fda639 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.395113 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f876d6-fac4-457d-bef2-a77fb7fda639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.433571 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c0f876d6-fac4-457d-bef2-a77fb7fda639 None None] MFA Rules not processed for user `f898ebe5fd924cd3b2b5e07df319ee69`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:57.434784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c0f876d6-fac4-457d-bef2-a77fb7fda639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:57.500836 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1344/2684] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:57.505400 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe586-cd74-4339-8337-e9660aab297b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.519195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:57.571236 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfe586-cd74-4339-8337-e9660aab297b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.575971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd624-8b8a-4cbd-8cb2-d2fe670af5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.576514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd624-8b8a-4cbd-8cb2-d2fe670af5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.576789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd624-8b8a-4cbd-8cb2-d2fe670af5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.577062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fd624-8b8a-4cbd-8cb2-d2fe670af5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.577719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd624-8b8a-4cbd-8cb2-d2fe670af5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.579611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fd624-8b8a-4cbd-8cb2-d2fe670af5c4 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.606549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1341/2685] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:48:57 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:48:57.610661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f876d6-fac4-457d-bef2-a77fb7fda639 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.621183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f876d6-fac4-457d-bef2-a77fb7fda639 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.672065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:57.679116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732a8be-b876-4b12-b861-4a6b90896f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.679725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732a8be-b876-4b12-b861-4a6b90896f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.680004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732a8be-b876-4b12-b861-4a6b90896f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.680294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732a8be-b876-4b12-b861-4a6b90896f30 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.680913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732a8be-b876-4b12-b861-4a6b90896f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.682835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732a8be-b876-4b12-b861-4a6b90896f30 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.704748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1345/2686] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:48:57 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:48:57.709577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd624-8b8a-4cbd-8cb2-d2fe670af5c4 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.719783 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fd624-8b8a-4cbd-8cb2-d2fe670af5c4 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.724294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95a399-0253-44f6-bc3e-5a6fb706cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.724885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95a399-0253-44f6-bc3e-5a6fb706cf06 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.725163 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95a399-0253-44f6-bc3e-5a6fb706cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.725433 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95a399-0253-44f6-bc3e-5a6fb706cf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.726106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95a399-0253-44f6-bc3e-5a6fb706cf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.727687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95a399-0253-44f6-bc3e-5a6fb706cf06 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.738234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1342/2687] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:57.742430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732a8be-b876-4b12-b861-4a6b90896f30 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.752254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732a8be-b876-4b12-b861-4a6b90896f30 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.757364 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca313-5e93-4218-9704-586d1c3f137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.758381 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca313-5e93-4218-9704-586d1c3f137a admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.758657 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca313-5e93-4218-9704-586d1c3f137a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.758932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca313-5e93-4218-9704-586d1c3f137a admin admin] PATH_INFO: `/v3/projects/d2f212a2ef80431392e18d59d15081f5/users/b8e97f2c6fa942debcc7249b466616d4/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.773961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ca313-5e93-4218-9704-586d1c3f137a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f212a2ef80431392e18d59d15081f5, user_id=b8e97f2c6fa942debcc7249b466616d4, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.776578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ca313-5e93-4218-9704-586d1c3f137a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.789168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1346/2688] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:57 2022] PUT /identity/v3/projects/d2f212a2ef80431392e18d59d15081f5/users/b8e97f2c6fa942debcc7249b466616d4/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:57.793180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95a399-0253-44f6-bc3e-5a6fb706cf06 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.803573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95a399-0253-44f6-bc3e-5a6fb706cf06 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.860770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4752b-4f6f-4382-aca8-7c8e716b8a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.861277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4752b-4f6f-4382-aca8-7c8e716b8a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.861588 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4752b-4f6f-4382-aca8-7c8e716b8a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.861869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4752b-4f6f-4382-aca8-7c8e716b8a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.862507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4752b-4f6f-4382-aca8-7c8e716b8a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.864097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4752b-4f6f-4382-aca8-7c8e716b8a31 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.873819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1343/2689] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:48:57.878084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca313-5e93-4218-9704-586d1c3f137a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:57.888931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca313-5e93-4218-9704-586d1c3f137a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:57.893499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:57.894212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.894494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.894770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] PATH_INFO: `/v3/projects/d2f212a2ef80431392e18d59d15081f5/users/b8e97f2c6fa942debcc7249b466616d4/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.897312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f212a2ef80431392e18d59d15081f5, user_id=b8e97f2c6fa942debcc7249b466616d4, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:57.900000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:57.911762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1347/2690] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:48:57 2022] PUT /identity/v3/projects/d2f212a2ef80431392e18d59d15081f5/users/b8e97f2c6fa942debcc7249b466616d4/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:48:57.923962 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5efb-8de9-476c-be6c-3799287ee0b5 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:57.924249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5efb-8de9-476c-be6c-3799287ee0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:57.924525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5efb-8de9-476c-be6c-3799287ee0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:57.954834 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b3bd5efb-8de9-476c-be6c-3799287ee0b5 None None] MFA Rules not processed for user `b8e97f2c6fa942debcc7249b466616d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:48:57.956042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b3bd5efb-8de9-476c-be6c-3799287ee0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:58.029080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1344/2691] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:48:58.041023 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:58.042742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:48:58.111611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7d8a0-6f50-43aa-bc8f-f1051c7f2484 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:58.116159 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d926f-4c78-4c7b-a72d-b65f51e7e0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:58.116821 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d926f-4c78-4c7b-a72d-b65f51e7e0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:58.117107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d926f-4c78-4c7b-a72d-b65f51e7e0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:58.117380 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d926f-4c78-4c7b-a72d-b65f51e7e0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:58.127415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d926f-4c78-4c7b-a72d-b65f51e7e0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:58.128872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d926f-4c78-4c7b-a72d-b65f51e7e0c1 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:58.140029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1348/2692] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:48:58.198205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd5efb-8de9-476c-be6c-3799287ee0b5 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:48:58.208160 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd5efb-8de9-476c-be6c-3799287ee0b5 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:48:58.211994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aa476-c22a-44ac-8f67-df58d1395610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:48:58.212609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa476-c22a-44ac-8f67-df58d1395610 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:48:58.212896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa476-c22a-44ac-8f67-df58d1395610 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:48:58.213174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa476-c22a-44ac-8f67-df58d1395610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:48:58.218503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:48:58.297147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aa476-c22a-44ac-8f67-df58d1395610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:48:58.298663 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aa476-c22a-44ac-8f67-df58d1395610 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:48:58.311342 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1345/2693] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:48:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:01.721134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d926f-4c78-4c7b-a72d-b65f51e7e0c1 service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:01.800505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d926f-4c78-4c7b-a72d-b65f51e7e0c1 service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:01.806143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:01.806863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:01.807272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:01.807617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] PATH_INFO: `/v3/users/f898ebe5fd924cd3b2b5e07df319ee69` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:01.809090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f898ebe5fd924cd3b2b5e07df319ee69)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:01.811059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:01.873399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f898ebe5fd924cd3b2b5e07df319ee69'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:01.874166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f898ebe5fd924cd3b2b5e07df319ee69'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:01.883088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:01.885174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f898ebe5fd924cd3b2b5e07df319ee69'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:01.888060 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f898ebe5fd924cd3b2b5e07df319ee69'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:01.901592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f898ebe5fd924cd3b2b5e07df319ee69'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:01.930449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1349/2694] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:49:01 2022] DELETE /identity/v3/users/f898ebe5fd924cd3b2b5e07df319ee69 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:49:01.935091 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1ee6-2c7a-4994-9384-9a57267bb47c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:01.935622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1ee6-2c7a-4994-9384-9a57267bb47c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:01.935724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1ee6-2c7a-4994-9384-9a57267bb47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:01.960918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-637f1ee6-2c7a-4994-9384-9a57267bb47c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:01.962332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-637f1ee6-2c7a-4994-9384-9a57267bb47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:02.065823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1346/2695] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:02.072904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:02.075116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:02.140088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1c0d5-3382-42c8-a498-f3017a1e0775 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:02.144330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ef11b-bde1-46a9-be41-9209a73c446d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:02.144974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef11b-bde1-46a9-be41-9209a73c446d service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:02.145224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef11b-bde1-46a9-be41-9209a73c446d service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:02.145499 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ef11b-bde1-46a9-be41-9209a73c446d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:02.157671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ef11b-bde1-46a9-be41-9209a73c446d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:02.159121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ef11b-bde1-46a9-be41-9209a73c446d service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:02.169205 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1350/2696] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:02.469128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b88e9-0a36-45b4-bcb5-a980b848cc9e None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:02.469742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b88e9-0a36-45b4-bcb5-a980b848cc9e None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:02.470266 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b88e9-0a36-45b4-bcb5-a980b848cc9e None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:02.473736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1347/2697] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:49:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:49:02.482045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bc82-c6ac-49bc-b192-54a92953058c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:02.482285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bc82-c6ac-49bc-b192-54a92953058c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:02.482593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bc82-c6ac-49bc-b192-54a92953058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:02.488390 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b88e9-0a36-45b4-bcb5-a980b848cc9e None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:02.495754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c82b88e9-0a36-45b4-bcb5-a980b848cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:02.504375 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d707bc82-c6ac-49bc-b192-54a92953058c None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:02.505792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d707bc82-c6ac-49bc-b192-54a92953058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:02.521764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b88e9-0a36-45b4-bcb5-a980b848cc9e None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:02.528562 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:02.529310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:02.529731 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:02.530111 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] PATH_INFO: `/v3/projects/2fe602611f6b44fd89cc6555bfa5682d` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:02.531624 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe602611f6b44fd89cc6555bfa5682d)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:02.534298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:02.600917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe602611f6b44fd89cc6555bfa5682d', 'request_id': 'req-15ae2409-80e9-4f4a-b43c-27aacba52e05'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.603214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1351/2698] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:02.626171 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bc82-c6ac-49bc-b192-54a92953058c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:02.627095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe602611f6b44fd89cc6555bfa5682d', 'request_id': 'req-15ae2409-80e9-4f4a-b43c-27aacba52e05'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.627923 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d707bc82-c6ac-49bc-b192-54a92953058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:02.635718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe602611f6b44fd89cc6555bfa5682d', 'request_id': 'req-15ae2409-80e9-4f4a-b43c-27aacba52e05'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.647648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] The token cache is being invalidate because project 2fe602611f6b44fd89cc6555bfa5682d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:49:02.647934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.648640 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.650761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1348/2699] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:49:02 2022] DELETE /identity/v3/projects/2fe602611f6b44fd89cc6555bfa5682d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:02.654789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:02.656233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:02.692540 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bc82-c6ac-49bc-b192-54a92953058c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:02.703577 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:02.715741 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:02.738398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae2409-80e9-4f4a-b43c-27aacba52e05 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:02.743987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:02.744778 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:02.745185 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:02.745819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] PATH_INFO: `/v3/users/b8e97f2c6fa942debcc7249b466616d4` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:02.746688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e97f2c6fa942debcc7249b466616d4)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:02.748722 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:02.750108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a2d22-5469-4ec1-afe1-2b3bb65873ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:02.750778 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a2d22-5469-4ec1-afe1-2b3bb65873ee service glance] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:02.751348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a2d22-5469-4ec1-afe1-2b3bb65873ee service glance] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:02.751348 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a2d22-5469-4ec1-afe1-2b3bb65873ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:02.753593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d49a2d22-5469-4ec1-afe1-2b3bb65873ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:02.796854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e97f2c6fa942debcc7249b466616d4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.804569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e97f2c6fa942debcc7249b466616d4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.805377 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e97f2c6fa942debcc7249b466616d4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.806149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e97f2c6fa942debcc7249b466616d4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.814064 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c5e9761c-2b55-4e21-9256-a734e73994b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e97f2c6fa942debcc7249b466616d4'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:02.828733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a2d22-5469-4ec1-afe1-2b3bb65873ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:02.830208 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a2d22-5469-4ec1-afe1-2b3bb65873ee service glance] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:02.832324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1349/2700] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:49:02 2022] DELETE /identity/v3/users/b8e97f2c6fa942debcc7249b466616d4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:49:02.841279 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1352/2701] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:02.911353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40b603-6c85-4253-b3c9-b1f3fb726fd8 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:02.911658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40b603-6c85-4253-b3c9-b1f3fb726fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:02.911913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40b603-6c85-4253-b3c9-b1f3fb726fd8 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:02.913852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1350/2702] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:49:02.919094 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28516725-d657-4053-93b2-ea8dc2a4790b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:02.919497 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28516725-d657-4053-93b2-ea8dc2a4790b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:02.919846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28516725-d657-4053-93b2-ea8dc2a4790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:02.943436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-28516725-d657-4053-93b2-ea8dc2a4790b None None] MFA Rules not processed for user `323b7d02f817475791098f32bf1c953e`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:02.944699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-28516725-d657-4053-93b2-ea8dc2a4790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:03.003581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1353/2703] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:03.016301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40b603-6c85-4253-b3c9-b1f3fb726fd8 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:03.018136 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7a40b603-6c85-4253-b3c9-b1f3fb726fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:03.033759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40b603-6c85-4253-b3c9-b1f3fb726fd8 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:03.038044 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ddccc-67f6-49da-ac84-4573c39d8b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:03.038755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ddccc-67f6-49da-ac84-4573c39d8b7c service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.039036 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ddccc-67f6-49da-ac84-4573c39d8b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.039312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ddccc-67f6-49da-ac84-4573c39d8b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.048087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ddccc-67f6-49da-ac84-4573c39d8b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:03.049353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ddccc-67f6-49da-ac84-4573c39d8b7c service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:03.059269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1351/2704] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:03.134552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28516725-d657-4053-93b2-ea8dc2a4790b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:03.136307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-28516725-d657-4053-93b2-ea8dc2a4790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:03.238462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28516725-d657-4053-93b2-ea8dc2a4790b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:03.244160 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:03.244810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.245095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.245372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] PATH_INFO: `/v3/projects/d2f212a2ef80431392e18d59d15081f5` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.246643 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f212a2ef80431392e18d59d15081f5)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:03.248592 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:03.268099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:03.307412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f212a2ef80431392e18d59d15081f5', 'request_id': 'req-82a56b92-ab43-43ed-8b7e-b40b297e27e4'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:03.316628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f212a2ef80431392e18d59d15081f5', 'request_id': 'req-82a56b92-ab43-43ed-8b7e-b40b297e27e4'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:03.324954 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f212a2ef80431392e18d59d15081f5', 'request_id': 'req-82a56b92-ab43-43ed-8b7e-b40b297e27e4'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:03.339117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] The token cache is being invalidate because project d2f212a2ef80431392e18d59d15081f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:49:03.339469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:03.340224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-82a56b92-ab43-43ed-8b7e-b40b297e27e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:03.341897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1354/2705] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:49:03 2022] DELETE /identity/v3/projects/d2f212a2ef80431392e18d59d15081f5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:03.347097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c826cc-db40-4410-bc7e-5caac209faba None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.347436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c826cc-db40-4410-bc7e-5caac209faba None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.347685 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c826cc-db40-4410-bc7e-5caac209faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.370556 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-13c826cc-db40-4410-bc7e-5caac209faba None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:03.371801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-13c826cc-db40-4410-bc7e-5caac209faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:03.473838 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1352/2706] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:49:03.482403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fcbec-2647-4f6a-bfd2-c4c6a1602bd4 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.482786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fcbec-2647-4f6a-bfd2-c4c6a1602bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.483134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fcbec-2647-4f6a-bfd2-c4c6a1602bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.505254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-f91fcbec-2647-4f6a-bfd2-c4c6a1602bd4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:03.506577 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f91fcbec-2647-4f6a-bfd2-c4c6a1602bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:03.516199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1355/2707] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:03.520749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c826cc-db40-4410-bc7e-5caac209faba None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:03.531481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c826cc-db40-4410-bc7e-5caac209faba None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:03.536336 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:03.536954 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.537233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.538114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.538772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:49:03.539071 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:03.540668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:03.553367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1353/2708] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:49:03.558492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fcbec-2647-4f6a-bfd2-c4c6a1602bd4 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:03.568513 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fcbec-2647-4f6a-bfd2-c4c6a1602bd4 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:03.573854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525085-1f60-4c4d-9729-109c868402ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:03.574478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525085-1f60-4c4d-9729-109c868402ae admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.574755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525085-1f60-4c4d-9729-109c868402ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.575030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525085-1f60-4c4d-9729-109c868402ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.575686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be525085-1f60-4c4d-9729-109c868402ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:03.577725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be525085-1f60-4c4d-9729-109c868402ae admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:03.609841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1356/2709] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:49:03 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:03.615104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:03.629113 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f392f-843c-41c3-aae0-161d165eed7d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:03.657394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:03.710682 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faa934-bfec-4bbf-a207-c79ef5c92b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:03.711313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa934-bfec-4bbf-a207-c79ef5c92b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.711591 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa934-bfec-4bbf-a207-c79ef5c92b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.711863 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa934-bfec-4bbf-a207-c79ef5c92b7f admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.712503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faa934-bfec-4bbf-a207-c79ef5c92b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:03.714482 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faa934-bfec-4bbf-a207-c79ef5c92b7f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:03.738604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1354/2710] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:49:03 2022] POST /identity/v3/users => generated 301 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:03.742769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525085-1f60-4c4d-9729-109c868402ae admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:03.754620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525085-1f60-4c4d-9729-109c868402ae admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:03.760573 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02be82-42bc-4730-b8df-bbc1a35c1a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:03.761196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02be82-42bc-4730-b8df-bbc1a35c1a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.761478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02be82-42bc-4730-b8df-bbc1a35c1a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.761785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02be82-42bc-4730-b8df-bbc1a35c1a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.762431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02be82-42bc-4730-b8df-bbc1a35c1a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:03.764187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02be82-42bc-4730-b8df-bbc1a35c1a70 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:03.775319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1357/2711] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:03.779290 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faa934-bfec-4bbf-a207-c79ef5c92b7f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:03.789769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faa934-bfec-4bbf-a207-c79ef5c92b7f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:03.794526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa502a-b34b-4968-b764-8ee314670dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:03.795140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa502a-b34b-4968-b764-8ee314670dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.795596 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa502a-b34b-4968-b764-8ee314670dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.795732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa502a-b34b-4968-b764-8ee314670dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.796325 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa502a-b34b-4968-b764-8ee314670dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:03.797976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa502a-b34b-4968-b764-8ee314670dc0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:03.808425 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1355/2712] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:03.812997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02be82-42bc-4730-b8df-bbc1a35c1a70 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:03.824308 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02be82-42bc-4730-b8df-bbc1a35c1a70 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:03.829140 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20215dc4-5a7c-44b5-a402-3e2cf92f3ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:03.830065 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20215dc4-5a7c-44b5-a402-3e2cf92f3ced admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.830226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20215dc4-5a7c-44b5-a402-3e2cf92f3ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.830541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20215dc4-5a7c-44b5-a402-3e2cf92f3ced admin admin] PATH_INFO: `/v3/projects/090500a6de91482d920d00d2649b1da0/users/4cbab9fd859540db8066e7a8461138c9/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.846528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20215dc4-5a7c-44b5-a402-3e2cf92f3ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=090500a6de91482d920d00d2649b1da0, user_id=4cbab9fd859540db8066e7a8461138c9, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:03.849183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20215dc4-5a7c-44b5-a402-3e2cf92f3ced admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:03.862078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1358/2713] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:49:03 2022] PUT /identity/v3/projects/090500a6de91482d920d00d2649b1da0/users/4cbab9fd859540db8066e7a8461138c9/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:03.872518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f40408-96bd-49c4-bd07-4374ec51fd8c None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:03.872809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f40408-96bd-49c4-bd07-4374ec51fd8c None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:03.873084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f40408-96bd-49c4-bd07-4374ec51fd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:03.902228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-17f40408-96bd-49c4-bd07-4374ec51fd8c None None] MFA Rules not processed for user `4cbab9fd859540db8066e7a8461138c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:03.903465 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-17f40408-96bd-49c4-bd07-4374ec51fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:03.969219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1356/2714] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:03.973946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20215dc4-5a7c-44b5-a402-3e2cf92f3ced admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.035898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20215dc4-5a7c-44b5-a402-3e2cf92f3ced admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.040561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90b843-a033-4e5a-a45f-c671d23cc714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.041168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90b843-a033-4e5a-a45f-c671d23cc714 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.041455 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90b843-a033-4e5a-a45f-c671d23cc714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.041763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90b843-a033-4e5a-a45f-c671d23cc714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.042398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90b843-a033-4e5a-a45f-c671d23cc714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.044288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90b843-a033-4e5a-a45f-c671d23cc714 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.072876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1359/2715] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:49:03 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:04.076945 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f40408-96bd-49c4-bd07-4374ec51fd8c None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.091668 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f40408-96bd-49c4-bd07-4374ec51fd8c None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.150337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea8e2-536a-4d1e-ad8e-4a4d1e8ecdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.151003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea8e2-536a-4d1e-ad8e-4a4d1e8ecdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.151367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea8e2-536a-4d1e-ad8e-4a4d1e8ecdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.151636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea8e2-536a-4d1e-ad8e-4a4d1e8ecdd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.152349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea8e2-536a-4d1e-ad8e-4a4d1e8ecdd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.154549 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea8e2-536a-4d1e-ad8e-4a4d1e8ecdd2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.169001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e775-0fac-4fc5-b41a-d248c105da9c None None] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.169299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e775-0fac-4fc5-b41a-d248c105da9c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.169640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679e775-0fac-4fc5-b41a-d248c105da9c None None] PATH_INFO: `/` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.171103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1360/2716] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 03 12:49:04.176588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1554-bbd6-4b8e-b1b8-2f65634541cf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.177103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1554-bbd6-4b8e-b1b8-2f65634541cf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.177545 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1554-bbd6-4b8e-b1b8-2f65634541cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.181564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1357/2717] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:49:04 2022] POST /identity/v3/users => generated 307 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:04.185253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea8e2-536a-4d1e-ad8e-4a4d1e8ecdd2 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.195639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea8e2-536a-4d1e-ad8e-4a4d1e8ecdd2 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.200295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7e063-095c-443c-93be-f33eafefdaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.200897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7e063-095c-443c-93be-f33eafefdaef admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.201176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7e063-095c-443c-93be-f33eafefdaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.201358 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-b3ef1554-bbd6-4b8e-b1b8-2f65634541cf None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:04.201493 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7e063-095c-443c-93be-f33eafefdaef admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.202106 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7e063-095c-443c-93be-f33eafefdaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.202679 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b3ef1554-bbd6-4b8e-b1b8-2f65634541cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:04.203691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7e063-095c-443c-93be-f33eafefdaef admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.214797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1358/2718] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:49:04.218804 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7e063-095c-443c-93be-f33eafefdaef admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.225006 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:04.229265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7e063-095c-443c-93be-f33eafefdaef admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.235198 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a87f0-3d4e-4db1-bbed-559a976f9d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.235978 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a87f0-3d4e-4db1-bbed-559a976f9d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.236332 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a87f0-3d4e-4db1-bbed-559a976f9d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.236616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a87f0-3d4e-4db1-bbed-559a976f9d8a admin admin] PATH_INFO: `/v3/projects/9075d2fee2164257b8af0c9643190256/users/ada98c0561b14283b227a772e706bca0/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.246526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:04.261002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a87f0-3d4e-4db1-bbed-559a976f9d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9075d2fee2164257b8af0c9643190256, user_id=ada98c0561b14283b227a772e706bca0, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.264610 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a87f0-3d4e-4db1-bbed-559a976f9d8a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.279620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1359/2719] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:49:04 2022] PUT /identity/v3/projects/9075d2fee2164257b8af0c9643190256/users/ada98c0561b14283b227a772e706bca0/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:49:04.283453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a87f0-3d4e-4db1-bbed-559a976f9d8a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.290035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1361/2720] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:49:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:04.300581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1554-bbd6-4b8e-b1b8-2f65634541cf None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.302467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b3ef1554-bbd6-4b8e-b1b8-2f65634541cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:04.345966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a87f0-3d4e-4db1-bbed-559a976f9d8a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.351473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eed2c1-d566-4250-a442-dc6104e92820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.352089 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed2c1-d566-4250-a442-dc6104e92820 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.352392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed2c1-d566-4250-a442-dc6104e92820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.352772 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eed2c1-d566-4250-a442-dc6104e92820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.353421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eed2c1-d566-4250-a442-dc6104e92820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.355066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eed2c1-d566-4250-a442-dc6104e92820 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.363084 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1554-bbd6-4b8e-b1b8-2f65634541cf None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.366027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1360/2721] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:04.369701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eed2c1-d566-4250-a442-dc6104e92820 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.379277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eed2c1-d566-4250-a442-dc6104e92820 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.384247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ecf323-4cf6-4b4d-a9b0-52aaf403ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.384891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecf323-4cf6-4b4d-a9b0-52aaf403ebdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.385203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecf323-4cf6-4b4d-a9b0-52aaf403ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.385566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ecf323-4cf6-4b4d-a9b0-52aaf403ebdf admin admin] PATH_INFO: `/v3/projects/9075d2fee2164257b8af0c9643190256/users/ada98c0561b14283b227a772e706bca0/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.387807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecf323-4cf6-4b4d-a9b0-52aaf403ebdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9075d2fee2164257b8af0c9643190256, user_id=ada98c0561b14283b227a772e706bca0, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.390735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ecf323-4cf6-4b4d-a9b0-52aaf403ebdf admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.401916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1361/2722] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:49:04 2022] PUT /identity/v3/projects/9075d2fee2164257b8af0c9643190256/users/ada98c0561b14283b227a772e706bca0/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:49:04.413605 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab79ee-96b9-4145-90fa-c70b31656d00 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.413969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab79ee-96b9-4145-90fa-c70b31656d00 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.414254 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab79ee-96b9-4145-90fa-c70b31656d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.426785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.427434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.427717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.428624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.442774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6bab79ee-96b9-4145-90fa-c70b31656d00 None None] MFA Rules not processed for user `ada98c0561b14283b227a772e706bca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:04.444045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6bab79ee-96b9-4145-90fa-c70b31656d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:04.505324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.506930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.519485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1362/2723] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:04 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:49:04.529482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1362/2724] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:04.530966 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab79ee-96b9-4145-90fa-c70b31656d00 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.532357 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6bab79ee-96b9-4145-90fa-c70b31656d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:04.597292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab79ee-96b9-4145-90fa-c70b31656d00 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.601497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079543d-f8c0-4872-888d-fd216c427541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.602157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079543d-f8c0-4872-888d-fd216c427541 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.602417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079543d-f8c0-4872-888d-fd216c427541 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.602696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079543d-f8c0-4872-888d-fd216c427541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.612542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079543d-f8c0-4872-888d-fd216c427541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.614023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079543d-f8c0-4872-888d-fd216c427541 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.619758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:04.627933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1363/2725] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:04 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:04.723785 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:04.725819 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:04.739306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:04.785379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fefa5-200c-4559-b2e1-d1c0cf2d548e service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:04.790814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e240cf7-3734-4a3e-ae92-b4e370d4ac39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:04.791755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240cf7-3734-4a3e-ae92-b4e370d4ac39 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:04.792104 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240cf7-3734-4a3e-ae92-b4e370d4ac39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:04.792553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240cf7-3734-4a3e-ae92-b4e370d4ac39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:04.861618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e240cf7-3734-4a3e-ae92-b4e370d4ac39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:04.862007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e240cf7-3734-4a3e-ae92-b4e370d4ac39 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:04.872078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1363/2726] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:04 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:08.957274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079543d-f8c0-4872-888d-fd216c427541 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:09.021339 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079543d-f8c0-4872-888d-fd216c427541 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:09.025997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:09.026615 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:09.026897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:09.027176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] PATH_INFO: `/v3/users/4cbab9fd859540db8066e7a8461138c9` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:09.028291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbab9fd859540db8066e7a8461138c9)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:09.030256 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:09.079057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbab9fd859540db8066e7a8461138c9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.086538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbab9fd859540db8066e7a8461138c9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.087244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbab9fd859540db8066e7a8461138c9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.087850 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbab9fd859540db8066e7a8461138c9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.096041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbab9fd859540db8066e7a8461138c9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.120544 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1364/2727] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:49:08 2022] DELETE /identity/v3/users/4cbab9fd859540db8066e7a8461138c9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:09.122421 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438abe-a670-4cb3-be22-abb5f8ac0fb6 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:09.122904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438abe-a670-4cb3-be22-abb5f8ac0fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:09.123029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438abe-a670-4cb3-be22-abb5f8ac0fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:09.142458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-2d438abe-a670-4cb3-be22-abb5f8ac0fb6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:09.143702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2d438abe-a670-4cb3-be22-abb5f8ac0fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:09.178680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:09.180278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:09.229980 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1364/2728] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:09.241052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438abe-a670-4cb3-be22-abb5f8ac0fb6 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:09.248803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2d438abe-a670-4cb3-be22-abb5f8ac0fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:09.278177 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc457b-203b-497d-8af0-bedf51af38bc admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:09.283147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:09.283959 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:09.284406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:09.284684 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] PATH_INFO: `/v3/users/c7971ebbb81f4d588bb6ff2f13b801a1` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:09.286181 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7971ebbb81f4d588bb6ff2f13b801a1)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:09.288401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:09.313376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:09.330014 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438abe-a670-4cb3-be22-abb5f8ac0fb6 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:09.335628 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84c330-3c73-4734-a107-ae7c2c86dd4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:09.336422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c330-3c73-4734-a107-ae7c2c86dd4f service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:09.336702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c330-3c73-4734-a107-ae7c2c86dd4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:09.337298 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84c330-3c73-4734-a107-ae7c2c86dd4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:09.350692 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84c330-3c73-4734-a107-ae7c2c86dd4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:09.351155 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7971ebbb81f4d588bb6ff2f13b801a1'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.352464 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84c330-3c73-4734-a107-ae7c2c86dd4f service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:09.360732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7971ebbb81f4d588bb6ff2f13b801a1'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.361779 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7971ebbb81f4d588bb6ff2f13b801a1'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.363023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7971ebbb81f4d588bb6ff2f13b801a1'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.364503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1365/2729] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:09.373146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7971ebbb81f4d588bb6ff2f13b801a1'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:09.397472 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1365/2730] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:49:09 2022] DELETE /identity/v3/users/c7971ebbb81f4d588bb6ff2f13b801a1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:09.402868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c703ce-8ae3-4b5d-a9b5-c152f9e9cb4a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:09.402868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c703ce-8ae3-4b5d-a9b5-c152f9e9cb4a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:09.402868 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c703ce-8ae3-4b5d-a9b5-c152f9e9cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:09.424465 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-94c703ce-8ae3-4b5d-a9b5-c152f9e9cb4a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:09.425764 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-94c703ce-8ae3-4b5d-a9b5-c152f9e9cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:09.431409 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:09.507621 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1366/2731] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:09.523813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:09.525736 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:09.638433 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a901a-1aef-4008-9093-e063ea5459ce admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:09.642793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:09.643558 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:09.643845 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:09.644123 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:09.656645 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:09.658346 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:09.671345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1366/2732] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:10.254576 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c703ce-8ae3-4b5d-a9b5-c152f9e9cb4a None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:10.257059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-94c703ce-8ae3-4b5d-a9b5-c152f9e9cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:10.280223 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c703ce-8ae3-4b5d-a9b5-c152f9e9cb4a None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:10.284974 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:10.285632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.285920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.286199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] PATH_INFO: `/v3/projects/090500a6de91482d920d00d2649b1da0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.288141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=090500a6de91482d920d00d2649b1da0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:10.290132 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:10.348360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090500a6de91482d920d00d2649b1da0', 'request_id': 'req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.357411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090500a6de91482d920d00d2649b1da0', 'request_id': 'req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.366478 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090500a6de91482d920d00d2649b1da0', 'request_id': 'req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.383269 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] The token cache is being invalidate because project 090500a6de91482d920d00d2649b1da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:49:10.385102 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.389033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:10.390801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:10.396482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.398559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1367/2733] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:49:10 2022] DELETE /identity/v3/projects/090500a6de91482d920d00d2649b1da0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:10.402323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:10.404468 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:10.407409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46faa4b-48f8-43c1-969f-6423e9218fd3 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:10.481866 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57cfb0-45c8-441f-bafd-9287fbbfa8a2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:10.484500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:10.485143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.485427 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.485749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] PATH_INFO: `/v3/projects/43dda7993c134a1cbf43ca9cf07ed8c8` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.486934 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43dda7993c134a1cbf43ca9cf07ed8c8)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:10.487431 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:10.488137 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.488425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.488701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] PATH_INFO: `/v3/users/ada98c0561b14283b227a772e706bca0` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.488876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:10.489877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada98c0561b14283b227a772e706bca0)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:10.492449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:10.533969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:10.536433 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:10.544753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada98c0561b14283b227a772e706bca0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.545344 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43dda7993c134a1cbf43ca9cf07ed8c8', 'request_id': 'req-c160295b-dbbd-4859-976f-d522f3d0ac74'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.546311 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada98c0561b14283b227a772e706bca0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.554130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43dda7993c134a1cbf43ca9cf07ed8c8', 'request_id': 'req-c160295b-dbbd-4859-976f-d522f3d0ac74'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.555035 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada98c0561b14283b227a772e706bca0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.555701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada98c0561b14283b227a772e706bca0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.561436 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43dda7993c134a1cbf43ca9cf07ed8c8', 'request_id': 'req-c160295b-dbbd-4859-976f-d522f3d0ac74'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.563443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ab70dec3-cd58-4cb7-b97b-beccc7a887a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada98c0561b14283b227a772e706bca0'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.572977 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] The token cache is being invalidate because project 43dda7993c134a1cbf43ca9cf07ed8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:49:10.573267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.573936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c160295b-dbbd-4859-976f-d522f3d0ac74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:10.575550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1367/2734] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:49:10 2022] DELETE /identity/v3/projects/43dda7993c134a1cbf43ca9cf07ed8c8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:10.576724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf6443-c1c2-43d6-b09c-a36c0b9763e2 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.577006 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf6443-c1c2-43d6-b09c-a36c0b9763e2 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.577359 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf6443-c1c2-43d6-b09c-a36c0b9763e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.582601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1368/2735] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:49:10 2022] DELETE /identity/v3/users/ada98c0561b14283b227a772e706bca0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:49:10.584073 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f33eb-0ad1-40b7-8489-f74f09ed9544 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.584434 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f33eb-0ad1-40b7-8489-f74f09ed9544 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.584659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f33eb-0ad1-40b7-8489-f74f09ed9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.597380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f2bf6443-c1c2-43d6-b09c-a36c0b9763e2 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:10.598635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f2bf6443-c1c2-43d6-b09c-a36c0b9763e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:10.606869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ca4f33eb-0ad1-40b7-8489-f74f09ed9544 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:10.608151 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ca4f33eb-0ad1-40b7-8489-f74f09ed9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:10.665139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1368/2736] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:49:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:10.682507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf6443-c1c2-43d6-b09c-a36c0b9763e2 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:10.684576 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f2bf6443-c1c2-43d6-b09c-a36c0b9763e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:10.689583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1369/2737] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:10.696941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8b27b-cae5-4f9b-9969-a730ff3bfbd7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.697392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8b27b-cae5-4f9b-9969-a730ff3bfbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.697810 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8b27b-cae5-4f9b-9969-a730ff3bfbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.726827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ffb8b27b-cae5-4f9b-9969-a730ff3bfbd7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:10.728240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ffb8b27b-cae5-4f9b-9969-a730ff3bfbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:10.737973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1370/2738] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:10.742242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8b27b-cae5-4f9b-9969-a730ff3bfbd7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:10.753777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8b27b-cae5-4f9b-9969-a730ff3bfbd7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:10.762377 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:10.763008 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.763290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.763567 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.764864 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:49:10.764864 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:10.766529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:10.784493 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1371/2739] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:49:10.785557 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:10.791396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf6443-c1c2-43d6-b09c-a36c0b9763e2 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:10.796608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447562d-f44e-45ab-a49c-9baa97df035a admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:10.797414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad5c6b-1935-4331-8357-56984bb25612 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:10.798110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5c6b-1935-4331-8357-56984bb25612 service swift] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.798398 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5c6b-1935-4331-8357-56984bb25612 service swift] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.798677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5c6b-1935-4331-8357-56984bb25612 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.802086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:10.802979 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:10.803427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:10.803873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:10.804918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:10.807108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:10.808127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad5c6b-1935-4331-8357-56984bb25612 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:10.809757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad5c6b-1935-4331-8357-56984bb25612 service swift] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:10.819195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1369/2740] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:49:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:49:10.847458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1372/2741] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:49:10 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:49:10.849119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad5c6b-1935-4331-8357-56984bb25612 service swift] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:10.866712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad5c6b-1935-4331-8357-56984bb25612 service swift] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:10.936946 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:10.940987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:11.031816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44509f9a-1bc5-4dae-8789-9a30770d6ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.032449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44509f9a-1bc5-4dae-8789-9a30770d6ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.032793 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44509f9a-1bc5-4dae-8789-9a30770d6ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.033077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44509f9a-1bc5-4dae-8789-9a30770d6ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.033821 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44509f9a-1bc5-4dae-8789-9a30770d6ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.035968 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44509f9a-1bc5-4dae-8789-9a30770d6ce1 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.065135 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659125d-66f8-41dc-ad13-434ad4d8bab7 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.071449 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.072129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:11.072897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.074239 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.074826 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] PATH_INFO: `/v3/projects/9075d2fee2164257b8af0c9643190256` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.078294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9075d2fee2164257b8af0c9643190256)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.081751 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.090680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1370/2742] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:49:10 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:11.094829 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44509f9a-1bc5-4dae-8789-9a30770d6ce1 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.114932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44509f9a-1bc5-4dae-8789-9a30770d6ce1 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.127077 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:11.127724 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782631e-753f-4608-954f-42cb7b0b641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.130142 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782631e-753f-4608-954f-42cb7b0b641d admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.131687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782631e-753f-4608-954f-42cb7b0b641d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.133614 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782631e-753f-4608-954f-42cb7b0b641d admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.135269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782631e-753f-4608-954f-42cb7b0b641d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.139817 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782631e-753f-4608-954f-42cb7b0b641d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.163315 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1371/2743] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:49:11.169035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782631e-753f-4608-954f-42cb7b0b641d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.211170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782631e-753f-4608-954f-42cb7b0b641d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.213613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9075d2fee2164257b8af0c9643190256', 'request_id': 'req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:11.225718 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9075d2fee2164257b8af0c9643190256', 'request_id': 'req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:11.241374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9075d2fee2164257b8af0c9643190256', 'request_id': 'req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:11.267614 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] The token cache is being invalidate because project 9075d2fee2164257b8af0c9643190256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:49:11.268312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:11.268930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-9db3e8e4-4b09-48a8-8c93-193ef8c8accc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:11.271215 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1373/2744] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:49:10 2022] DELETE /identity/v3/projects/9075d2fee2164257b8af0c9643190256 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:11.292792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec468f-2fb5-4585-a32a-8849a4525e8a None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.293138 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec468f-2fb5-4585-a32a-8849a4525e8a None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.293405 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec468f-2fb5-4585-a32a-8849a4525e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.315620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.316368 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.316661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.316942 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.317661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.320104 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.327012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ecec468f-2fb5-4585-a32a-8849a4525e8a None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:11.336538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1372/2745] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:11.337849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.339799 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:11.340933 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ecec468f-2fb5-4585-a32a-8849a4525e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:11.355270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1374/2746] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:11.363492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fb494-89b4-4c1d-882e-50d7700a29a3 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.363808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fb494-89b4-4c1d-882e-50d7700a29a3 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.364088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fb494-89b4-4c1d-882e-50d7700a29a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.365828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ef15-bb4e-4a4d-a893-543bb87d7f93 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.371898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d424eb-76b1-4f05-94e2-bda260b1bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.372881 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d424eb-76b1-4f05-94e2-bda260b1bcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.373225 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d424eb-76b1-4f05-94e2-bda260b1bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.373627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d424eb-76b1-4f05-94e2-bda260b1bcaf admin admin] PATH_INFO: `/v3/projects/2bc0ab3abcd44ac9abecc379437a55c8/users/6bde96e680824395ab96fb8906414e0a/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.406536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d424eb-76b1-4f05-94e2-bda260b1bcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc0ab3abcd44ac9abecc379437a55c8, user_id=6bde96e680824395ab96fb8906414e0a, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.411801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-534fb494-89b4-4c1d-882e-50d7700a29a3 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:11.412879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d424eb-76b1-4f05-94e2-bda260b1bcaf admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.413652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-534fb494-89b4-4c1d-882e-50d7700a29a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:11.432880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1375/2747] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:11.437072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fb494-89b4-4c1d-882e-50d7700a29a3 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.457081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1373/2748] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:49:11 2022] PUT /identity/v3/projects/2bc0ab3abcd44ac9abecc379437a55c8/users/6bde96e680824395ab96fb8906414e0a/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:11.457333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fb494-89b4-4c1d-882e-50d7700a29a3 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.548723 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698a29c-8245-4927-a4cd-22359178a3bf None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.549016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698a29c-8245-4927-a4cd-22359178a3bf None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.549274 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698a29c-8245-4927-a4cd-22359178a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.587059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3698a29c-8245-4927-a4cd-22359178a3bf None None] MFA Rules not processed for user `6bde96e680824395ab96fb8906414e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:11.590227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3698a29c-8245-4927-a4cd-22359178a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:11.608626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.609697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.610194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.610659 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.611523 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:49:11.612088 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.614277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.628408 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1376/2749] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:49:11.633763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.655261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973e654-eb25-43b9-ab68-8ef4741b8a31 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.663410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eddb9-0e08-403d-afd0-2d74d9e0d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.664419 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eddb9-0e08-403d-afd0-2d74d9e0d4bb admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.664786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eddb9-0e08-403d-afd0-2d74d9e0d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.665143 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eddb9-0e08-403d-afd0-2d74d9e0d4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.665936 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eddb9-0e08-403d-afd0-2d74d9e0d4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.667995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eddb9-0e08-403d-afd0-2d74d9e0d4bb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.721812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1377/2750] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:49:11 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:11.723770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eddb9-0e08-403d-afd0-2d74d9e0d4bb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.736809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1374/2751] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:49:11.750970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698a29c-8245-4927-a4cd-22359178a3bf None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.752732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3698a29c-8245-4927-a4cd-22359178a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:11.812231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eddb9-0e08-403d-afd0-2d74d9e0d4bb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.815035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:11.820754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74345a2e-1ade-487b-ab61-ccfadab0935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.821645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74345a2e-1ade-487b-ab61-ccfadab0935c admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.822111 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74345a2e-1ade-487b-ab61-ccfadab0935c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.822602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74345a2e-1ade-487b-ab61-ccfadab0935c admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.823262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74345a2e-1ade-487b-ab61-ccfadab0935c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.825307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74345a2e-1ade-487b-ab61-ccfadab0935c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.835872 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:11.838041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698a29c-8245-4927-a4cd-22359178a3bf None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.859336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1378/2752] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:49:11 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:49:11.865624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74345a2e-1ade-487b-ab61-ccfadab0935c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.883618 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74345a2e-1ade-487b-ab61-ccfadab0935c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.888536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba3074-215d-4a2f-89fa-da4b6fc3b73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.889200 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3074-215d-4a2f-89fa-da4b6fc3b73d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.889438 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3074-215d-4a2f-89fa-da4b6fc3b73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.889909 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3074-215d-4a2f-89fa-da4b6fc3b73d admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.890565 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba3074-215d-4a2f-89fa-da4b6fc3b73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.892244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba3074-215d-4a2f-89fa-da4b6fc3b73d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.908988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1379/2753] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:11.913770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba3074-215d-4a2f-89fa-da4b6fc3b73d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:11.928449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b5e79-dffb-4ab5-b920-149a800c256f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.929082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b5e79-dffb-4ab5-b920-149a800c256f service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.929365 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b5e79-dffb-4ab5-b920-149a800c256f service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.929687 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b5e79-dffb-4ab5-b920-149a800c256f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.937719 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba3074-215d-4a2f-89fa-da4b6fc3b73d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:11.949429 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39e974-f35e-499b-8e37-6bda01facd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:11.950516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39e974-f35e-499b-8e37-6bda01facd85 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:11.950973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39e974-f35e-499b-8e37-6bda01facd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:11.951436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39e974-f35e-499b-8e37-6bda01facd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:11.952697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39e974-f35e-499b-8e37-6bda01facd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:11.955917 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39e974-f35e-499b-8e37-6bda01facd85 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:11.980646 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1380/2754] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:11.985999 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39e974-f35e-499b-8e37-6bda01facd85 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:12.017950 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39e974-f35e-499b-8e37-6bda01facd85 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:12.028555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b5e79-dffb-4ab5-b920-149a800c256f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:12.029560 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ac1e6-d9d3-4c9e-9be4-83f230e0a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:12.030275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b5e79-dffb-4ab5-b920-149a800c256f service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:12.030402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac1e6-d9d3-4c9e-9be4-83f230e0a3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:12.030792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac1e6-d9d3-4c9e-9be4-83f230e0a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:12.031152 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ac1e6-d9d3-4c9e-9be4-83f230e0a3d6 admin admin] PATH_INFO: `/v3/projects/261b3dd1ad8e458b9a71232e2990a8db/users/5acfebc7bf664e4fbf9a8b103ad80196/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:12.045704 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1375/2755] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:49:12.052398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac1e6-d9d3-4c9e-9be4-83f230e0a3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=261b3dd1ad8e458b9a71232e2990a8db, user_id=5acfebc7bf664e4fbf9a8b103ad80196, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:12.056391 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ac1e6-d9d3-4c9e-9be4-83f230e0a3d6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:12.079413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b5e79-dffb-4ab5-b920-149a800c256f service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:12.088857 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1381/2756] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:49:11 2022] PUT /identity/v3/projects/261b3dd1ad8e458b9a71232e2990a8db/users/5acfebc7bf664e4fbf9a8b103ad80196/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:12.093794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b5e79-dffb-4ab5-b920-149a800c256f service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:12.095808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befc4cd-1704-40b6-b95f-48349647c469 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:12.096097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befc4cd-1704-40b6-b95f-48349647c469 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:12.101880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befc4cd-1704-40b6-b95f-48349647c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:12.147829 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4befc4cd-1704-40b6-b95f-48349647c469 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:12.149095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4befc4cd-1704-40b6-b95f-48349647c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:12.221870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:12.223059 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:12.223648 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:12.224138 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] PATH_INFO: `/v3/users/6bde96e680824395ab96fb8906414e0a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:12.225860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bde96e680824395ab96fb8906414e0a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:12.228782 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:12.256811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1382/2757] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:12.267765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befc4cd-1704-40b6-b95f-48349647c469 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:12.270064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4befc4cd-1704-40b6-b95f-48349647c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:12.305943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bde96e680824395ab96fb8906414e0a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:12.322224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bde96e680824395ab96fb8906414e0a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:12.323232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bde96e680824395ab96fb8906414e0a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:12.324045 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bde96e680824395ab96fb8906414e0a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:12.326296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:12.335295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4fe3b36d-eeab-49be-968a-b2fcd88dccdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bde96e680824395ab96fb8906414e0a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:12.368563 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befc4cd-1704-40b6-b95f-48349647c469 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:12.368995 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1376/2758] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:49:12 2022] DELETE /identity/v3/users/6bde96e680824395ab96fb8906414e0a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:49:12.373461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efe899-9a4a-4df7-be01-117c6a94c7bc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:12.374539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efe899-9a4a-4df7-be01-117c6a94c7bc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:12.375023 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efe899-9a4a-4df7-be01-117c6a94c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:12.406160 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e0efe899-9a4a-4df7-be01-117c6a94c7bc None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:12.407568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e0efe899-9a4a-4df7-be01-117c6a94c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:12.484514 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:12.485274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:12.485713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:12.486163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:12.488992 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:12.493564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1377/2759] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:49:12.503593 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efe899-9a4a-4df7-be01-117c6a94c7bc None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:12.505725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e0efe899-9a4a-4df7-be01-117c6a94c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:12.513808 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:12.515586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:12.527673 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efe899-9a4a-4df7-be01-117c6a94c7bc None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:12.534255 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e312e-d6b8-4873-a6ba-d43b07e03d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:12.534764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e312e-d6b8-4873-a6ba-d43b07e03d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:12.535125 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e312e-d6b8-4873-a6ba-d43b07e03d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:12.535410 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e312e-d6b8-4873-a6ba-d43b07e03d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:12.540977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1383/2760] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:12.550131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e312e-d6b8-4873-a6ba-d43b07e03d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:12.551852 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e312e-d6b8-4873-a6ba-d43b07e03d79 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:12.566655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1378/2761] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:49:13.164063 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:13.166115 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:13.178884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:13.194183 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc505-af1e-48c5-a24a-b49362f3e34f service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:13.209983 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:13.210969 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:13.211525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:13.211988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] PATH_INFO: `/v3/projects/2bc0ab3abcd44ac9abecc379437a55c8` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:13.214276 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc0ab3abcd44ac9abecc379437a55c8)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:13.216949 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:13.361076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc0ab3abcd44ac9abecc379437a55c8', 'request_id': 'req-cf176c51-48d9-427b-abd4-2a92f17170c3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:13.386530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc0ab3abcd44ac9abecc379437a55c8', 'request_id': 'req-cf176c51-48d9-427b-abd4-2a92f17170c3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:13.399916 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc0ab3abcd44ac9abecc379437a55c8', 'request_id': 'req-cf176c51-48d9-427b-abd4-2a92f17170c3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:13.428110 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] The token cache is being invalidate because project 2bc0ab3abcd44ac9abecc379437a55c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:49:13.428404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:13.429095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:13.431000 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1384/2762] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:49:13 2022] DELETE /identity/v3/projects/2bc0ab3abcd44ac9abecc379437a55c8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:13.888941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e391fe-6808-4263-84e9-b82a2c5b72dc None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:13.888941 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e391fe-6808-4263-84e9-b82a2c5b72dc None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:13.889622 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e391fe-6808-4263-84e9-b82a2c5b72dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:13.970306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-74e391fe-6808-4263-84e9-b82a2c5b72dc None None] MFA Rules not processed for user `5acfebc7bf664e4fbf9a8b103ad80196`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:13.974534 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-74e391fe-6808-4263-84e9-b82a2c5b72dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:14.083002 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1379/2763] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:14.085967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:14.092813 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:14.233219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf176c51-48d9-427b-abd4-2a92f17170c3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:14.238650 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0397d-2403-476b-b136-6b49680e64bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:14.239292 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0397d-2403-476b-b136-6b49680e64bc admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:14.239602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0397d-2403-476b-b136-6b49680e64bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:14.239880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0397d-2403-476b-b136-6b49680e64bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:14.241158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0397d-2403-476b-b136-6b49680e64bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:14.243978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0397d-2403-476b-b136-6b49680e64bc admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:14.295515 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1385/2764] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:49:14 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:14.300153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e391fe-6808-4263-84e9-b82a2c5b72dc None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:14.313795 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e391fe-6808-4263-84e9-b82a2c5b72dc None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:14.369229 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:14.384166 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd85d-97db-4bd8-b74e-ad40d58532c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:14.385170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd85d-97db-4bd8-b74e-ad40d58532c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:14.386066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd85d-97db-4bd8-b74e-ad40d58532c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:14.386625 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd85d-97db-4bd8-b74e-ad40d58532c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:14.387862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bd85d-97db-4bd8-b74e-ad40d58532c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:14.391384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bd85d-97db-4bd8-b74e-ad40d58532c2 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:14.418232 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1380/2765] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:49:14 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:14.422350 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0397d-2403-476b-b136-6b49680e64bc admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:14.433685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0397d-2403-476b-b136-6b49680e64bc admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:14.438507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6af7-cfc5-45c0-b8e9-8e6667477afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:14.439133 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6af7-cfc5-45c0-b8e9-8e6667477afb admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:14.439410 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6af7-cfc5-45c0-b8e9-8e6667477afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:14.439677 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6af7-cfc5-45c0-b8e9-8e6667477afb admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:14.440316 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd6af7-cfc5-45c0-b8e9-8e6667477afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:14.441959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd6af7-cfc5-45c0-b8e9-8e6667477afb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:14.457584 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1386/2766] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:49:14.461082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd85d-97db-4bd8-b74e-ad40d58532c2 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:14.472306 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd85d-97db-4bd8-b74e-ad40d58532c2 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:14.477537 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138a89-c4f4-446a-afff-52c6a8fb3515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:14.478288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138a89-c4f4-446a-afff-52c6a8fb3515 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:14.478572 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138a89-c4f4-446a-afff-52c6a8fb3515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:14.478973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138a89-c4f4-446a-afff-52c6a8fb3515 admin admin] PATH_INFO: `/v3/projects/2615663df6ef4d8ab512a7a170d95b66/users/d33a9c8aba9b4a4d8b2903e4721add47/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:14.504756 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db138a89-c4f4-446a-afff-52c6a8fb3515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2615663df6ef4d8ab512a7a170d95b66, user_id=d33a9c8aba9b4a4d8b2903e4721add47, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:14.508504 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db138a89-c4f4-446a-afff-52c6a8fb3515 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:14.531732 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1381/2767] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:49:14 2022] PUT /identity/v3/projects/2615663df6ef4d8ab512a7a170d95b66/users/d33a9c8aba9b4a4d8b2903e4721add47/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:14.536097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6af7-cfc5-45c0-b8e9-8e6667477afb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:14.546884 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6af7-cfc5-45c0-b8e9-8e6667477afb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:14.625330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:14.626004 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:14.626288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:14.626593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:14.627262 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:14.628863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:14.632236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:14.646386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1387/2768] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:14.647333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138a89-c4f4-446a-afff-52c6a8fb3515 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:14.658097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138a89-c4f4-446a-afff-52c6a8fb3515 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:14.663011 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9d9cc-d0f7-465b-9fb7-6276a27641f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:14.663760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d9cc-d0f7-465b-9fb7-6276a27641f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:14.664174 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d9cc-d0f7-465b-9fb7-6276a27641f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:14.664301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9d9cc-d0f7-465b-9fb7-6276a27641f9 admin admin] PATH_INFO: `/v3/projects/2615663df6ef4d8ab512a7a170d95b66/users/d33a9c8aba9b4a4d8b2903e4721add47/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:14.666443 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9d9cc-d0f7-465b-9fb7-6276a27641f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2615663df6ef4d8ab512a7a170d95b66, user_id=d33a9c8aba9b4a4d8b2903e4721add47, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:14.669128 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9d9cc-d0f7-465b-9fb7-6276a27641f9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:14.685188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1382/2769] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:49:14 2022] PUT /identity/v3/projects/2615663df6ef4d8ab512a7a170d95b66/users/d33a9c8aba9b4a4d8b2903e4721add47/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:49:15.303297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:15.306164 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:15.447520 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46aa63b-4b5d-4a9f-835b-dff3d218fd9d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:15.531241 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738907-4d05-460a-8318-6f5288189c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:15.531960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738907-4d05-460a-8318-6f5288189c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:15.532315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738907-4d05-460a-8318-6f5288189c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:15.532661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738907-4d05-460a-8318-6f5288189c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:15.544415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-f7738907-4d05-460a-8318-6f5288189c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:15.645262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67e918-921a-49ac-b9a5-46359df48c58 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:15.646998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67e918-921a-49ac-b9a5-46359df48c58 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:15.647973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67e918-921a-49ac-b9a5-46359df48c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:15.679525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7738907-4d05-460a-8318-6f5288189c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:15.681717 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7738907-4d05-460a-8318-6f5288189c15 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:15.684300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3e67e918-921a-49ac-b9a5-46359df48c58 None None] MFA Rules not processed for user `d33a9c8aba9b4a4d8b2903e4721add47`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:15.685974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3e67e918-921a-49ac-b9a5-46359df48c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:15.712967 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1388/2770] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:15.868176 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1383/2771] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:49:15.878602 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddeedf-5e95-4819-9f4e-5c18e1f483cf None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:15.880337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddeedf-5e95-4819-9f4e-5c18e1f483cf None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:15.881374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddeedf-5e95-4819-9f4e-5c18e1f483cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:15.916037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-eeddeedf-5e95-4819-9f4e-5c18e1f483cf None None] MFA Rules not processed for user `5acfebc7bf664e4fbf9a8b103ad80196`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:15.917743 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eeddeedf-5e95-4819-9f4e-5c18e1f483cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:16.008312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:16.019710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1389/2772] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:16.031458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67e918-921a-49ac-b9a5-46359df48c58 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:16.033094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3e67e918-921a-49ac-b9a5-46359df48c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:16.055333 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67e918-921a-49ac-b9a5-46359df48c58 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:16.061879 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa2219-be27-4c6f-b21d-47a6f9a8c849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:16.062511 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2219-be27-4c6f-b21d-47a6f9a8c849 service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:16.063392 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2219-be27-4c6f-b21d-47a6f9a8c849 service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:16.063678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2219-be27-4c6f-b21d-47a6f9a8c849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:16.074108 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa2219-be27-4c6f-b21d-47a6f9a8c849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:16.076084 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa2219-be27-4c6f-b21d-47a6f9a8c849 service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:16.086854 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1384/2773] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:16.148607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddeedf-5e95-4819-9f4e-5c18e1f483cf None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:16.150142 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eeddeedf-5e95-4819-9f4e-5c18e1f483cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:16.220186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddeedf-5e95-4819-9f4e-5c18e1f483cf None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:16.224570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:16.225333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:16.225652 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:16.225928 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:16.227696 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:16.243108 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:16.244555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:16.257423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1390/2774] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:26.082801 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=61,keystone:INSERT=5 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:26.251038 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=26 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:33.276404 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee10a96-c8e7-41a2-b605-7f30f08b110b None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:33.276948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee10a96-c8e7-41a2-b605-7f30f08b110b None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:33.276948 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee10a96-c8e7-41a2-b605-7f30f08b110b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:33.306303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-4ee10a96-c8e7-41a2-b605-7f30f08b110b None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:33.307754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4ee10a96-c8e7-41a2-b605-7f30f08b110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:33.371008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1385/2775] 10.222.0.17 () {58 vars in 967 bytes} [Mon Oct 3 12:49:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:33.384483 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:33.386013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:33.465976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ab00-a0a1-45bd-a932-d2773e9c902e service glance] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:33.471061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2ed14-620f-46c9-aeb8-ac49e8bc59de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:33.471681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ed14-620f-46c9-aeb8-ac49e8bc59de service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:33.471960 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ed14-620f-46c9-aeb8-ac49e8bc59de service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:33.472232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ed14-620f-46c9-aeb8-ac49e8bc59de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:33.481633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2ed14-620f-46c9-aeb8-ac49e8bc59de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:33.483212 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2ed14-620f-46c9-aeb8-ac49e8bc59de service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:33.491816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1391/2776] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:49:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:49:38.553475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee10a96-c8e7-41a2-b605-7f30f08b110b None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:38.554913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-4ee10a96-c8e7-41a2-b605-7f30f08b110b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:38.613525 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee10a96-c8e7-41a2-b605-7f30f08b110b None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:38.617140 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeee77f-39cf-443e-aafd-bddb781e4d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:38.617774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeee77f-39cf-443e-aafd-bddb781e4d5f service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:38.618052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeee77f-39cf-443e-aafd-bddb781e4d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:38.618320 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeee77f-39cf-443e-aafd-bddb781e4d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:38.627132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeee77f-39cf-443e-aafd-bddb781e4d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:38.628547 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeee77f-39cf-443e-aafd-bddb781e4d5f service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:38.638073 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1386/2777] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:49:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:49:43.488275 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=32 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:48.633969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=51 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:58.442177 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2ed14-620f-46c9-aeb8-ac49e8bc59de service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:58.508735 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2ed14-620f-46c9-aeb8-ac49e8bc59de service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:58.513300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:58.513962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:58.514242 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:58.514541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] PATH_INFO: `/v3/users/5acfebc7bf664e4fbf9a8b103ad80196` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:58.515834 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5acfebc7bf664e4fbf9a8b103ad80196)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:58.517795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:58.564771 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5acfebc7bf664e4fbf9a8b103ad80196'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.565360 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5acfebc7bf664e4fbf9a8b103ad80196'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.572661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5acfebc7bf664e4fbf9a8b103ad80196'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.573288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5acfebc7bf664e4fbf9a8b103ad80196'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.581529 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5acfebc7bf664e4fbf9a8b103ad80196'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.601323 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1392/2778] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:49:58 2022] DELETE /identity/v3/users/5acfebc7bf664e4fbf9a8b103ad80196 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:58.772860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeee77f-39cf-443e-aafd-bddb781e4d5f service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:58.783606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeee77f-39cf-443e-aafd-bddb781e4d5f service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:58.842871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:58.843415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:58.843695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:58.843970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] PATH_INFO: `/v3/projects/261b3dd1ad8e458b9a71232e2990a8db` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:58.845078 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=261b3dd1ad8e458b9a71232e2990a8db)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:58.847010 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:58.893483 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261b3dd1ad8e458b9a71232e2990a8db', 'request_id': 'req-39adb39f-0a33-41e7-bc4b-399d8d348b29'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.901327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261b3dd1ad8e458b9a71232e2990a8db', 'request_id': 'req-39adb39f-0a33-41e7-bc4b-399d8d348b29'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.908095 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261b3dd1ad8e458b9a71232e2990a8db', 'request_id': 'req-39adb39f-0a33-41e7-bc4b-399d8d348b29'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.919408 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] The token cache is being invalidate because project 261b3dd1ad8e458b9a71232e2990a8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:49:58.919701 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.920358 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:58.921899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1387/2779] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:49:58 2022] DELETE /identity/v3/projects/261b3dd1ad8e458b9a71232e2990a8db => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:58.926591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:58.928030 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:58.940940 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c2469-f75b-4481-8349-6c6b9657ef8f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:58.995961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:58.996590 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:58.996865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:58.997139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] PATH_INFO: `/v3/users/d33a9c8aba9b4a4d8b2903e4721add47` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:58.998556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33a9c8aba9b4a4d8b2903e4721add47)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:59.000500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:59.023473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:59.047878 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33a9c8aba9b4a4d8b2903e4721add47'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.048613 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33a9c8aba9b4a4d8b2903e4721add47'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.056328 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33a9c8aba9b4a4d8b2903e4721add47'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.056977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33a9c8aba9b4a4d8b2903e4721add47'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.064544 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-28f23a93-64c4-431a-81c8-408b44b46e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33a9c8aba9b4a4d8b2903e4721add47'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.081961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1393/2780] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:49:58 2022] DELETE /identity/v3/users/d33a9c8aba9b4a4d8b2903e4721add47 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:59.253068 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:59.254562 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:59.268020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adb39f-0a33-41e7-bc4b-399d8d348b29 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:59.326037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:59.326669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.326946 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.327219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] PATH_INFO: `/v3/projects/2615663df6ef4d8ab512a7a170d95b66` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.328330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2615663df6ef4d8ab512a7a170d95b66)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:59.330354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:59.365272 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:59.378211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2615663df6ef4d8ab512a7a170d95b66', 'request_id': 'req-257b1827-a885-4dce-9578-08f3e4f490d9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.385754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2615663df6ef4d8ab512a7a170d95b66', 'request_id': 'req-257b1827-a885-4dce-9578-08f3e4f490d9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.392351 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2615663df6ef4d8ab512a7a170d95b66', 'request_id': 'req-257b1827-a885-4dce-9578-08f3e4f490d9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.403891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] The token cache is being invalidate because project 2615663df6ef4d8ab512a7a170d95b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:49:59.404182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.404835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-257b1827-a885-4dce-9578-08f3e4f490d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:49:59.406428 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1388/2781] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:49:59 2022] DELETE /identity/v3/projects/2615663df6ef4d8ab512a7a170d95b66 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:59.412865 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe55f3-f7fa-48f6-b07d-338264a8748c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.413259 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe55f3-f7fa-48f6-b07d-338264a8748c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.413586 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe55f3-f7fa-48f6-b07d-338264a8748c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.433049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7bfe55f3-f7fa-48f6-b07d-338264a8748c None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:59.434288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7bfe55f3-f7fa-48f6-b07d-338264a8748c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:59.494194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1394/2782] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:59.504820 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b5a9-d02b-4abb-af83-5845237427da None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.505109 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b5a9-d02b-4abb-af83-5845237427da None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.505395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b5a9-d02b-4abb-af83-5845237427da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.527292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8d86b5a9-d02b-4abb-af83-5845237427da None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:59.528524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8d86b5a9-d02b-4abb-af83-5845237427da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:59.537372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1389/2783] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:59.541769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe55f3-f7fa-48f6-b07d-338264a8748c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:59.552310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe55f3-f7fa-48f6-b07d-338264a8748c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:59.557053 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:59.557699 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.557986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.558266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.558920 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:49:59.559233 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:59.560835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:59.573833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1395/2784] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:49:59.578278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b5a9-d02b-4abb-af83-5845237427da None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:59.588360 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b5a9-d02b-4abb-af83-5845237427da None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:59.593595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4803910-112e-48d8-9eb1-8ef42230c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:59.594201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4803910-112e-48d8-9eb1-8ef42230c79a admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.594473 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4803910-112e-48d8-9eb1-8ef42230c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.594749 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4803910-112e-48d8-9eb1-8ef42230c79a admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.595402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4803910-112e-48d8-9eb1-8ef42230c79a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:59.597355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4803910-112e-48d8-9eb1-8ef42230c79a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:59.624573 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1390/2785] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:49:59 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:59.628817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:59.639615 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0936eb-e2cc-406a-be2d-30f280de66ea admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:59.697875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b9ca6-b580-49bc-8604-f8bc59dbf309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:59.698500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b9ca6-b580-49bc-8604-f8bc59dbf309 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.698782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b9ca6-b580-49bc-8604-f8bc59dbf309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.699058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b9ca6-b580-49bc-8604-f8bc59dbf309 admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.699688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b9ca6-b580-49bc-8604-f8bc59dbf309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:59.701623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b9ca6-b580-49bc-8604-f8bc59dbf309 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:59.724085 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1396/2786] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:49:59 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:49:59.728226 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4803910-112e-48d8-9eb1-8ef42230c79a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:59.738856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4803910-112e-48d8-9eb1-8ef42230c79a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:59.743543 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c24a-eec9-48e1-925a-70add74cdaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:59.744150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c24a-eec9-48e1-925a-70add74cdaba admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.744432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c24a-eec9-48e1-925a-70add74cdaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.744703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9c24a-eec9-48e1-925a-70add74cdaba admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.745343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9c24a-eec9-48e1-925a-70add74cdaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:59.746971 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9c24a-eec9-48e1-925a-70add74cdaba admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:59.758085 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1391/2787] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:59.762089 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b9ca6-b580-49bc-8604-f8bc59dbf309 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:59.772399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b9ca6-b580-49bc-8604-f8bc59dbf309 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:59.776988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4507dff-789b-4be6-a118-8e3c104c16a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:59.777617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507dff-789b-4be6-a118-8e3c104c16a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.777897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507dff-789b-4be6-a118-8e3c104c16a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.778170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4507dff-789b-4be6-a118-8e3c104c16a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.778811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4507dff-789b-4be6-a118-8e3c104c16a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:59.780386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4507dff-789b-4be6-a118-8e3c104c16a9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:59.791881 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1397/2788] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:49:59.796175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c24a-eec9-48e1-925a-70add74cdaba admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:49:59.806635 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9c24a-eec9-48e1-925a-70add74cdaba admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:49:59.811260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82c8f0-3eac-44b5-b4e9-5e3534a72bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:49:59.811969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c8f0-3eac-44b5-b4e9-5e3534a72bcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.812326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c8f0-3eac-44b5-b4e9-5e3534a72bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.812669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82c8f0-3eac-44b5-b4e9-5e3534a72bcc admin admin] PATH_INFO: `/v3/projects/425ffba5169b42328a015963a0b79d96/users/a0450de3f9c04651a1025db17f18e5ab/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.827828 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82c8f0-3eac-44b5-b4e9-5e3534a72bcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=425ffba5169b42328a015963a0b79d96, user_id=a0450de3f9c04651a1025db17f18e5ab, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:49:59.830501 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82c8f0-3eac-44b5-b4e9-5e3534a72bcc admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:49:59.843825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1392/2789] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:49:59 2022] PUT /identity/v3/projects/425ffba5169b42328a015963a0b79d96/users/a0450de3f9c04651a1025db17f18e5ab/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:49:59.854130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bad4fe-3baf-42d2-8896-1b688effa13c None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:49:59.854415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bad4fe-3baf-42d2-8896-1b688effa13c None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:49:59.854690 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bad4fe-3baf-42d2-8896-1b688effa13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:49:59.862636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:49:59.884632 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-75bad4fe-3baf-42d2-8896-1b688effa13c None None] MFA Rules not processed for user `a0450de3f9c04651a1025db17f18e5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:49:59.885896 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-75bad4fe-3baf-42d2-8896-1b688effa13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:49:59.950594 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1398/2790] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:49:59.954950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82c8f0-3eac-44b5-b4e9-5e3534a72bcc admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:00.017348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82c8f0-3eac-44b5-b4e9-5e3534a72bcc admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:00.022714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f5379-d534-49ec-9f0c-e287b0afd9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:00.023319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5379-d534-49ec-9f0c-e287b0afd9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:00.023606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5379-d534-49ec-9f0c-e287b0afd9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:00.023889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f5379-d534-49ec-9f0c-e287b0afd9c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:00.024538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f5379-d534-49ec-9f0c-e287b0afd9c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:00.026490 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f5379-d534-49ec-9f0c-e287b0afd9c5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:00.052656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1393/2791] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:49:59 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:50:00.056732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bad4fe-3baf-42d2-8896-1b688effa13c None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:00.068196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bad4fe-3baf-42d2-8896-1b688effa13c None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:00.128688 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eacf6-72d7-4960-9782-e5ca0759516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:00.129845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eacf6-72d7-4960-9782-e5ca0759516d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:00.130127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eacf6-72d7-4960-9782-e5ca0759516d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:00.130403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206eacf6-72d7-4960-9782-e5ca0759516d admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:00.131039 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206eacf6-72d7-4960-9782-e5ca0759516d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:00.133222 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206eacf6-72d7-4960-9782-e5ca0759516d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:00.157439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1399/2792] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:50:00 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:50:00.161503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f5379-d534-49ec-9f0c-e287b0afd9c5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:00.172295 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f5379-d534-49ec-9f0c-e287b0afd9c5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:00.177464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba68a6-f816-4af7-98c2-9e4d4d17d5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:00.178101 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba68a6-f816-4af7-98c2-9e4d4d17d5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:00.178381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba68a6-f816-4af7-98c2-9e4d4d17d5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:00.178656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba68a6-f816-4af7-98c2-9e4d4d17d5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:00.179292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba68a6-f816-4af7-98c2-9e4d4d17d5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:00.180926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba68a6-f816-4af7-98c2-9e4d4d17d5f5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:00.192383 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1394/2793] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:50:00.196769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eacf6-72d7-4960-9782-e5ca0759516d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:00.207404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206eacf6-72d7-4960-9782-e5ca0759516d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:00.212254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99020119-a7af-40f8-a7a3-07d47efc1a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:00.212915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99020119-a7af-40f8-a7a3-07d47efc1a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:00.213199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99020119-a7af-40f8-a7a3-07d47efc1a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:00.213501 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99020119-a7af-40f8-a7a3-07d47efc1a2e admin admin] PATH_INFO: `/v3/projects/0a4624375eff42d69977c96078db884e/users/dd37631074e04dd7a3d03cdcba5a76ec/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:00.228995 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99020119-a7af-40f8-a7a3-07d47efc1a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4624375eff42d69977c96078db884e, user_id=dd37631074e04dd7a3d03cdcba5a76ec, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:00.231683 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99020119-a7af-40f8-a7a3-07d47efc1a2e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:00.245895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1400/2794] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:50:00 2022] PUT /identity/v3/projects/0a4624375eff42d69977c96078db884e/users/dd37631074e04dd7a3d03cdcba5a76ec/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:50:00.249917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba68a6-f816-4af7-98c2-9e4d4d17d5f5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:00.261230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba68a6-f816-4af7-98c2-9e4d4d17d5f5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:00.293889 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:00.325738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26e7fb-368e-4e70-8736-559c603c222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:00.326378 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e7fb-368e-4e70-8736-559c603c222f admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:00.326647 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e7fb-368e-4e70-8736-559c603c222f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:00.326927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e7fb-368e-4e70-8736-559c603c222f admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:00.327574 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26e7fb-368e-4e70-8736-559c603c222f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:00.329180 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26e7fb-368e-4e70-8736-559c603c222f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:00.339285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1395/2795] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:50:00.343582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99020119-a7af-40f8-a7a3-07d47efc1a2e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:00.354056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99020119-a7af-40f8-a7a3-07d47efc1a2e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:00.358682 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:00.359342 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:00.359626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:00.359931 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] PATH_INFO: `/v3/projects/0a4624375eff42d69977c96078db884e/users/dd37631074e04dd7a3d03cdcba5a76ec/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:00.361924 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4624375eff42d69977c96078db884e, user_id=dd37631074e04dd7a3d03cdcba5a76ec, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:00.365067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:00.375977 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1401/2796] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:50:00 2022] PUT /identity/v3/projects/0a4624375eff42d69977c96078db884e/users/dd37631074e04dd7a3d03cdcba5a76ec/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:50:00.388530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964ce7e-2ad7-40f4-a4d0-05cc0f7bb9cd None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:00.388815 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964ce7e-2ad7-40f4-a4d0-05cc0f7bb9cd None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:00.389102 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964ce7e-2ad7-40f4-a4d0-05cc0f7bb9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:00.427416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7964ce7e-2ad7-40f4-a4d0-05cc0f7bb9cd None None] MFA Rules not processed for user `dd37631074e04dd7a3d03cdcba5a76ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:50:00.429391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7964ce7e-2ad7-40f4-a4d0-05cc0f7bb9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:00.500316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1396/2797] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:50:00.512266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:00.514047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:00.566591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:00.572966 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6b9c-06f3-4af5-bbff-e458a8a7a9fe admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:00.576867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc5509-e498-4ce3-8650-772804284361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:00.577471 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5509-e498-4ce3-8650-772804284361 service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:00.577786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5509-e498-4ce3-8650-772804284361 service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:00.578064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5509-e498-4ce3-8650-772804284361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:00.637192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc5509-e498-4ce3-8650-772804284361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:00.638680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc5509-e498-4ce3-8650-772804284361 service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:00.647918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1402/2798] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:50:03.188831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964ce7e-2ad7-40f4-a4d0-05cc0f7bb9cd None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:03.251597 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964ce7e-2ad7-40f4-a4d0-05cc0f7bb9cd None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:03.256092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:03.256721 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:03.257001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:03.257551 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] PATH_INFO: `/v3/users/a0450de3f9c04651a1025db17f18e5ab` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:03.258677 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0450de3f9c04651a1025db17f18e5ab)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:03.260602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:03.307919 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0450de3f9c04651a1025db17f18e5ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.313310 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:03.315516 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0450de3f9c04651a1025db17f18e5ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.316618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0450de3f9c04651a1025db17f18e5ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.317849 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0450de3f9c04651a1025db17f18e5ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.326263 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0450de3f9c04651a1025db17f18e5ab'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.343917 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1397/2799] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:50:03 2022] DELETE /identity/v3/users/a0450de3f9c04651a1025db17f18e5ab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:50:03.349772 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511e8d-3f9a-4764-9f80-cda6fbd3d525 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:03.350299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511e8d-3f9a-4764-9f80-cda6fbd3d525 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:03.350403 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511e8d-3f9a-4764-9f80-cda6fbd3d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:03.369074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-29511e8d-3f9a-4764-9f80-cda6fbd3d525 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:50:03.370307 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-29511e8d-3f9a-4764-9f80-cda6fbd3d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:03.434056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1403/2800] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:50:03.444159 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:03.445618 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:03.503241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0481465-ee4a-4886-9f29-bc8319067000 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:03.507035 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b965e50-8489-4e56-bb48-06623e7ef500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:03.507899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965e50-8489-4e56-bb48-06623e7ef500 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:03.508210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965e50-8489-4e56-bb48-06623e7ef500 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:03.508489 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b965e50-8489-4e56-bb48-06623e7ef500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:03.522282 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b965e50-8489-4e56-bb48-06623e7ef500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:03.524353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b965e50-8489-4e56-bb48-06623e7ef500 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:03.541718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1398/2801] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 03 12:50:03.825598 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511e8d-3f9a-4764-9f80-cda6fbd3d525 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:03.827398 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-29511e8d-3f9a-4764-9f80-cda6fbd3d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:03.840645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511e8d-3f9a-4764-9f80-cda6fbd3d525 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:03.846337 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:03.846988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:03.847274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:03.847553 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] PATH_INFO: `/v3/projects/425ffba5169b42328a015963a0b79d96` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:03.848792 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] RBAC: Authorizing `identity:delete_project(project_id=425ffba5169b42328a015963a0b79d96)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:03.851224 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:03.903895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425ffba5169b42328a015963a0b79d96', 'request_id': 'req-122e4a40-f7af-4470-bd83-6552886c299e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.911399 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425ffba5169b42328a015963a0b79d96', 'request_id': 'req-122e4a40-f7af-4470-bd83-6552886c299e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.918042 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425ffba5169b42328a015963a0b79d96', 'request_id': 'req-122e4a40-f7af-4470-bd83-6552886c299e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.929199 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] The token cache is being invalidate because project 425ffba5169b42328a015963a0b79d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:50:03.929458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.930141 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:03.931638 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1404/2802] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:50:03 2022] DELETE /identity/v3/projects/425ffba5169b42328a015963a0b79d96 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:50:03.935627 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b965e50-8489-4e56-bb48-06623e7ef500 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:03.945913 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b965e50-8489-4e56-bb48-06623e7ef500 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:03.999805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:04.000417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.000696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.000970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] PATH_INFO: `/v3/users/dd37631074e04dd7a3d03cdcba5a76ec` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.002130 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd37631074e04dd7a3d03cdcba5a76ec)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:04.004718 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:04.051370 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd37631074e04dd7a3d03cdcba5a76ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.058539 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd37631074e04dd7a3d03cdcba5a76ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.059195 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd37631074e04dd7a3d03cdcba5a76ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.059791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd37631074e04dd7a3d03cdcba5a76ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.067730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-96650d98-3173-4ec6-8a0c-a32dadb6dbac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd37631074e04dd7a3d03cdcba5a76ec'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.077651 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:04.086215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1399/2803] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:50:03 2022] DELETE /identity/v3/users/dd37631074e04dd7a3d03cdcba5a76ec => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:50:04.372082 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:04.373622 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:04.387203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e4a40-f7af-4470-bd83-6552886c299e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:04.408517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:04.447880 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:04.448511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.448788 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.449059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] PATH_INFO: `/v3/projects/0a4624375eff42d69977c96078db884e` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.450186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4624375eff42d69977c96078db884e)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:04.452068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:04.497388 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4624375eff42d69977c96078db884e', 'request_id': 'req-fcaff901-d02d-4418-94c4-c929bdb7835b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.505040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4624375eff42d69977c96078db884e', 'request_id': 'req-fcaff901-d02d-4418-94c4-c929bdb7835b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.511680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4624375eff42d69977c96078db884e', 'request_id': 'req-fcaff901-d02d-4418-94c4-c929bdb7835b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.522524 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] The token cache is being invalidate because project 0a4624375eff42d69977c96078db884e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:50:04.522811 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.523448 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-fcaff901-d02d-4418-94c4-c929bdb7835b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:04.524929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1405/2804] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:50:04 2022] DELETE /identity/v3/projects/0a4624375eff42d69977c96078db884e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:50:04.530666 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854004bb-5997-4371-85bd-db94d397866f None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.531154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854004bb-5997-4371-85bd-db94d397866f None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.531267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854004bb-5997-4371-85bd-db94d397866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.550771 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-854004bb-5997-4371-85bd-db94d397866f None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:50:04.551982 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-854004bb-5997-4371-85bd-db94d397866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:04.609609 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1400/2805] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:50:04.617320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e525a58-4d57-4adc-8470-dd00cf2df6bd None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.617803 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e525a58-4d57-4adc-8470-dd00cf2df6bd None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.618173 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e525a58-4d57-4adc-8470-dd00cf2df6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.638593 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-4e525a58-4d57-4adc-8470-dd00cf2df6bd None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:50:04.639805 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4e525a58-4d57-4adc-8470-dd00cf2df6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:04.648361 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1406/2806] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:50:04.652657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854004bb-5997-4371-85bd-db94d397866f None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:04.662413 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854004bb-5997-4371-85bd-db94d397866f None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:04.667145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:04.667746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.668049 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.668324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.668965 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:50:04.669269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:04.670893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:04.682950 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1401/2807] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:50:04.687280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e525a58-4d57-4adc-8470-dd00cf2df6bd None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:04.697336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e525a58-4d57-4adc-8470-dd00cf2df6bd None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:04.702061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586914-721f-41d0-b054-6ad6f9e05f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:04.702702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586914-721f-41d0-b054-6ad6f9e05f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.702985 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586914-721f-41d0-b054-6ad6f9e05f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.703261 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42586914-721f-41d0-b054-6ad6f9e05f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.703914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42586914-721f-41d0-b054-6ad6f9e05f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:04.705835 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42586914-721f-41d0-b054-6ad6f9e05f63 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:04.733530 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1407/2808] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:50:04 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:50:04.737765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:04.748312 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43219b5f-81b8-4bd0-9ce0-85fb0c89b23c admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:04.807765 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaeda7-69d8-45ba-8455-a4ab09bf647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:04.808372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaeda7-69d8-45ba-8455-a4ab09bf647b admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.808655 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaeda7-69d8-45ba-8455-a4ab09bf647b admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.808927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaeda7-69d8-45ba-8455-a4ab09bf647b admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.809584 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaeda7-69d8-45ba-8455-a4ab09bf647b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:04.811608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaeda7-69d8-45ba-8455-a4ab09bf647b admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:04.833287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1402/2809] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:50:04 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:50:04.837467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586914-721f-41d0-b054-6ad6f9e05f63 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:04.847669 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42586914-721f-41d0-b054-6ad6f9e05f63 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:04.852334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b0beb-d378-4295-8062-cead26fe0410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:04.852929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0beb-d378-4295-8062-cead26fe0410 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.853209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0beb-d378-4295-8062-cead26fe0410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.853484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0beb-d378-4295-8062-cead26fe0410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.854163 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0beb-d378-4295-8062-cead26fe0410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:04.855744 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0beb-d378-4295-8062-cead26fe0410 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:04.866061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1408/2810] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:50:04.869974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaeda7-69d8-45ba-8455-a4ab09bf647b admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:04.880808 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaeda7-69d8-45ba-8455-a4ab09bf647b admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:04.885866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20816cda-8821-4a3b-ad38-a4329e736838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:04.886467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20816cda-8821-4a3b-ad38-a4329e736838 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.886757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20816cda-8821-4a3b-ad38-a4329e736838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.887033 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20816cda-8821-4a3b-ad38-a4329e736838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.887678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20816cda-8821-4a3b-ad38-a4329e736838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:04.889284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20816cda-8821-4a3b-ad38-a4329e736838 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:04.900139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1403/2811] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:50:04.904402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b0beb-d378-4295-8062-cead26fe0410 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:04.914656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b0beb-d378-4295-8062-cead26fe0410 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:04.919581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:04.920354 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.920637 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.920915 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] PATH_INFO: `/v3/projects/3efa232c3d9b416d9735b817e94e48b4/users/85584dea2ebf4c5e8628ed746fd574fc/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.936635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efa232c3d9b416d9735b817e94e48b4, user_id=85584dea2ebf4c5e8628ed746fd574fc, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:04.939334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:04.952769 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1409/2812] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:50:04 2022] PUT /identity/v3/projects/3efa232c3d9b416d9735b817e94e48b4/users/85584dea2ebf4c5e8628ed746fd574fc/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:50:04.964126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbef8-5a38-47ba-9fd2-7fdb4be16f93 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:04.964415 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbef8-5a38-47ba-9fd2-7fdb4be16f93 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:04.964696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbef8-5a38-47ba-9fd2-7fdb4be16f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:04.992602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-6e1dbef8-5a38-47ba-9fd2-7fdb4be16f93 None None] MFA Rules not processed for user `85584dea2ebf4c5e8628ed746fd574fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:50:04.993837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6e1dbef8-5a38-47ba-9fd2-7fdb4be16f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:05.040774 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:05.060884 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1404/2813] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:50:05.073210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:05.074997 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:05.131703 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09f4aa-8c7b-4b7e-933c-0b86fb9bafb6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:05.135629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5982550-5b51-468e-b11c-ac8041b5ecf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:05.136236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5982550-5b51-468e-b11c-ac8041b5ecf9 service glance] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:05.136517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5982550-5b51-468e-b11c-ac8041b5ecf9 service glance] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:05.136791 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5982550-5b51-468e-b11c-ac8041b5ecf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:05.141908 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:05.147117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5982550-5b51-468e-b11c-ac8041b5ecf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:05.148907 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5982550-5b51-468e-b11c-ac8041b5ecf9 service glance] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:05.159013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1410/2814] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:50:07.852210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dbef8-5a38-47ba-9fd2-7fdb4be16f93 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:07.853702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6e1dbef8-5a38-47ba-9fd2-7fdb4be16f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:07.915114 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dbef8-5a38-47ba-9fd2-7fdb4be16f93 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:07.918690 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe7973-92e0-44b8-aa4e-8d02b1dac324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:07.919302 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe7973-92e0-44b8-aa4e-8d02b1dac324 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:07.919587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe7973-92e0-44b8-aa4e-8d02b1dac324 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:07.919869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe7973-92e0-44b8-aa4e-8d02b1dac324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:07.922092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-61fe7973-92e0-44b8-aa4e-8d02b1dac324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:07.934311 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe7973-92e0-44b8-aa4e-8d02b1dac324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:07.935764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe7973-92e0-44b8-aa4e-8d02b1dac324 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:07.945122 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1405/2815] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:50:15.155333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:17.940629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=31 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:34.257121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5982550-5b51-468e-b11c-ac8041b5ecf9 service glance] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:34.327569 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5982550-5b51-468e-b11c-ac8041b5ecf9 service glance] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:34.332626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:34.333257 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:34.333554 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:34.333833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] PATH_INFO: `/v3/users/85584dea2ebf4c5e8628ed746fd574fc` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:34.334978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=85584dea2ebf4c5e8628ed746fd574fc)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:34.336877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:34.386191 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85584dea2ebf4c5e8628ed746fd574fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.386855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85584dea2ebf4c5e8628ed746fd574fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.395314 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85584dea2ebf4c5e8628ed746fd574fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.396045 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85584dea2ebf4c5e8628ed746fd574fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.403476 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85584dea2ebf4c5e8628ed746fd574fc'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.421339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1411/2816] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:50:34 2022] DELETE /identity/v3/users/85584dea2ebf4c5e8628ed746fd574fc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:50:34.425938 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236b01-66e1-44c0-a66f-77b6580e32e4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:34.426431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236b01-66e1-44c0-a66f-77b6580e32e4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:34.426550 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6236b01-66e1-44c0-a66f-77b6580e32e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:34.445710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-c6236b01-66e1-44c0-a66f-77b6580e32e4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:50:34.446916 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c6236b01-66e1-44c0-a66f-77b6580e32e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:34.505994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1406/2817] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:50:34.515965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:34.517374 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:34.574238 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8bbe7-86b3-4db3-a862-e3a2f4ddc95d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:34.577901 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:34.578502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:34.578781 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:34.579054 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:34.588517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:34.589975 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:34.599648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1412/2818] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:50:34.871391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236b01-66e1-44c0-a66f-77b6580e32e4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:34.872877 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-c6236b01-66e1-44c0-a66f-77b6580e32e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:34.885992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6236b01-66e1-44c0-a66f-77b6580e32e4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:34.890642 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:34.891271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:34.891548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:34.891818 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] PATH_INFO: `/v3/projects/3efa232c3d9b416d9735b817e94e48b4` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:34.892997 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efa232c3d9b416d9735b817e94e48b4)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:34.894920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:34.943154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efa232c3d9b416d9735b817e94e48b4', 'request_id': 'req-4b682326-59a6-49e2-95b8-14d46a2e5a5f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.950800 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efa232c3d9b416d9735b817e94e48b4', 'request_id': 'req-4b682326-59a6-49e2-95b8-14d46a2e5a5f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.957820 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efa232c3d9b416d9735b817e94e48b4', 'request_id': 'req-4b682326-59a6-49e2-95b8-14d46a2e5a5f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.968832 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] The token cache is being invalidate because project 3efa232c3d9b416d9735b817e94e48b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:50:34.969127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.969825 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-4b682326-59a6-49e2-95b8-14d46a2e5a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:50:34.971327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1407/2819] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:50:34 2022] DELETE /identity/v3/projects/3efa232c3d9b416d9735b817e94e48b4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:50:42.900855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:42.902303 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:42.933326 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:42.991939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780dd4-55a4-4ee3-91aa-44d1c92f9745 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:43.072195 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:43.072831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:43.073116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:43.073394 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:43.075273 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:43.089674 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:43.091428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:43.108021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1413/2820] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:50:44.965536 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:45.863893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870aa25-4b54-4360-b95b-a59aad3aacb7 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:45.864264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870aa25-4b54-4360-b95b-a59aad3aacb7 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:45.864650 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870aa25-4b54-4360-b95b-a59aad3aacb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:45.885422 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7870aa25-4b54-4360-b95b-a59aad3aacb7 None None] MFA Rules not processed for user `357459a31a3a4fedb2af627c317abc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:50:45.886669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7870aa25-4b54-4360-b95b-a59aad3aacb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:45.944566 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1408/2821] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:50:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:50:46.249078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:46.250498 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:46.306387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e10c7d-a798-409f-a7fb-8b832ef47ab7 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:46.312312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:46.313338 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:46.313869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:46.314373 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:46.317400 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:46.330833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:46.332747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:46.340963 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1414/2822] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:50:47.692623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870aa25-4b54-4360-b95b-a59aad3aacb7 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:47.694238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7870aa25-4b54-4360-b95b-a59aad3aacb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:47.773926 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870aa25-4b54-4360-b95b-a59aad3aacb7 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:47.778974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:47.779587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:47.779874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:47.780165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:47.781969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:47.794639 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:47.796228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:47.806744 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1409/2823] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:50:56.337272 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=78 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:50:56.766440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:50:56.767941 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:56.784277 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb3e80-f327-4fdd-9f61-f49d3ec5338b service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:50:56.790506 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:50:56.791194 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:50:56.791541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:50:56.791882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:50:56.793707 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:50:56.806007 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:50:56.807583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:50:56.818862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1415/2824] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:50:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:50:57.802211 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=57 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:00.773395 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:51:00.775037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:51:00.791406 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b231-2bf5-4c46-a650-ec8700e9ac2b service placement] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:51:00.797150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce747f4c-b130-4c32-8aa3-733da0ff23ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:51:00.797759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce747f4c-b130-4c32-8aa3-733da0ff23ad service nova] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:51:00.798046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce747f4c-b130-4c32-8aa3-733da0ff23ad service nova] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:51:00.798327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce747f4c-b130-4c32-8aa3-733da0ff23ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:51:00.800115 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-ce747f4c-b130-4c32-8aa3-733da0ff23ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:51:00.813726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce747f4c-b130-4c32-8aa3-733da0ff23ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:51:00.815277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce747f4c-b130-4c32-8aa3-733da0ff23ad service nova] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:51:00.827000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1410/2825] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:51:06.814556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:51:10.821967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=6 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:15.888663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:52:15.900957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164bb4b-c7d3-47e0-963b-2636d0e41445 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:52:15.906914 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:52:15.907528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:15.907815 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:15.908093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:15.909854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:15.920797 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:52:15.922416 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:52:15.931990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1416/2826] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:52:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:52:25.927730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=6 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:37.242935 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80875b-1e59-4a61-b3a2-f1e4bd02402d None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:37.243866 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80875b-1e59-4a61-b3a2-f1e4bd02402d None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:37.244480 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80875b-1e59-4a61-b3a2-f1e4bd02402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:37.298110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-3f80875b-1e59-4a61-b3a2-f1e4bd02402d None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:52:37.299319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-3f80875b-1e59-4a61-b3a2-f1e4bd02402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:37.366372 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1411/2827] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:52:37.417288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:52:37.418856 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:37.515392 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1a8c1-5439-40f7-b9c8-0f0afdbc0933 service nova] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:52:37.521072 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b0fbe-7b72-4fb3-b4fe-47f66f48c26a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:52:37.521730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0fbe-7b72-4fb3-b4fe-47f66f48c26a service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:37.522019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0fbe-7b72-4fb3-b4fe-47f66f48c26a service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:37.522296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b0fbe-7b72-4fb3-b4fe-47f66f48c26a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:37.532278 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b0fbe-7b72-4fb3-b4fe-47f66f48c26a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:52:37.533925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b0fbe-7b72-4fb3-b4fe-47f66f48c26a service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:52:37.542746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1417/2828] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:52:47.363337 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=40 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:47.539244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=41 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:52:53.749283 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55900-4302-4761-9d86-d026b2076543 None None] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:53.749831 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55900-4302-4761-9d86-d026b2076543 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:53.749986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55900-4302-4761-9d86-d026b2076543 None None] PATH_INFO: `/` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:53.751349 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1412/2829] 10.222.0.17 () {54 vars in 921 bytes} [Mon Oct 3 12:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 03 12:52:53.757148 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bea9a-21bc-497c-8c5c-dda9c2a2729f None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:53.757641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bea9a-21bc-497c-8c5c-dda9c2a2729f None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:53.757833 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bea9a-21bc-497c-8c5c-dda9c2a2729f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:53.797266 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-755bea9a-21bc-497c-8c5c-dda9c2a2729f None None] MFA Rules not processed for user `589b89539f8d43e993201fab13cd443a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:52:53.798538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-755bea9a-21bc-497c-8c5c-dda9c2a2729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:53.808415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1418/2830] 10.222.0.17 () {58 vars in 1018 bytes} [Mon Oct 3 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:52:53.819885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae55900-4302-4761-9d86-d026b2076543 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:52:53.821753 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6ae55900-4302-4761-9d86-d026b2076543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:53.883478 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae55900-4302-4761-9d86-d026b2076543 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:52:53.887497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb582d-7b8c-49fc-bb06-c9bfe25a5025 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:52:53.888354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb582d-7b8c-49fc-bb06-c9bfe25a5025 service glance] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:53.888528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb582d-7b8c-49fc-bb06-c9bfe25a5025 service glance] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:53.888807 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb582d-7b8c-49fc-bb06-c9bfe25a5025 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:53.901439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb582d-7b8c-49fc-bb06-c9bfe25a5025 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:52:53.902927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb582d-7b8c-49fc-bb06-c9bfe25a5025 service glance] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:52:53.915267 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1413/2831] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:52:53.982653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bea9a-21bc-497c-8c5c-dda9c2a2729f None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:52:53.984051 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-755bea9a-21bc-497c-8c5c-dda9c2a2729f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:53.996312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bea9a-21bc-497c-8c5c-dda9c2a2729f None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:52:53.999929 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a4e8-03ca-4ac3-825b-d31697751fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:52:54.000521 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a4e8-03ca-4ac3-825b-d31697751fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:54.000804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a4e8-03ca-4ac3-825b-d31697751fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:54.001080 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a4e8-03ca-4ac3-825b-d31697751fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:54.002782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4f18a4e8-03ca-4ac3-825b-d31697751fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:54.012474 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18a4e8-03ca-4ac3-825b-d31697751fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:52:54.013958 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18a4e8-03ca-4ac3-825b-d31697751fb2 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:52:54.022032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1419/2832] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:52:54.094099 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb582d-7b8c-49fc-bb06-c9bfe25a5025 service glance] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:52:54.104057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb582d-7b8c-49fc-bb06-c9bfe25a5025 service glance] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:52:54.107634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:52:54.108218 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:54.108497 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:54.108769 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:54.110532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:54.125062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:52:54.126485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:52:54.137726 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1414/2833] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:52:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:52:55.841753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362342d2-e60f-45ea-a3e0-7c9a7795757b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:55.842254 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362342d2-e60f-45ea-a3e0-7c9a7795757b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:55.842370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362342d2-e60f-45ea-a3e0-7c9a7795757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:55.861991 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-362342d2-e60f-45ea-a3e0-7c9a7795757b None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:52:55.863201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-362342d2-e60f-45ea-a3e0-7c9a7795757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:52:55.870283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1420/2834] 10.222.0.17 () {58 vars in 1009 bytes} [Mon Oct 3 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:52:55.882500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:52:55.893784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94706111-eb72-426d-91aa-84af2471fb18 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:52:55.899448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b852c-d8d7-4838-857c-1c4e0b841908 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:52:55.900050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b852c-d8d7-4838-857c-1c4e0b841908 service swift] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:52:55.900330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b852c-d8d7-4838-857c-1c4e0b841908 service swift] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:52:55.900603 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b852c-d8d7-4838-857c-1c4e0b841908 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:52:55.910203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b852c-d8d7-4838-857c-1c4e0b841908 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:52:55.912481 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b852c-d8d7-4838-857c-1c4e0b841908 service swift] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:52:55.921210 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1415/2835] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:52:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:53:05.856847 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=18 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:05.917953 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=38 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:12.836831 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362342d2-e60f-45ea-a3e0-7c9a7795757b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:53:12.849220 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362342d2-e60f-45ea-a3e0-7c9a7795757b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:53:12.854260 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:53:12.855049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:53:12.855353 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:53:12.855611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:53:12.857367 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:53:12.869481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:53:12.871107 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:53:12.882467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1421/2836] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:53:15.719980 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52559-1591-4fe1-bd7b-7522cdbb6ac4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:53:15.720456 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52559-1591-4fe1-bd7b-7522cdbb6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:53:15.720561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52559-1591-4fe1-bd7b-7522cdbb6ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:53:15.739429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-63c52559-1591-4fe1-bd7b-7522cdbb6ac4 None None] MFA Rules not processed for user `df857935a0644938938b7fd8c33eabf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:53:15.740611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-63c52559-1591-4fe1-bd7b-7522cdbb6ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:53:15.747758 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1416/2837] 10.222.0.17 () {58 vars in 967 bytes} [Mon Oct 3 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:53:15.761032 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:53:15.772918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a540bb4-80ea-47db-b4a4-f8baba60e46a service placement] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:53:15.778115 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861cd51-6ab9-4fa8-9684-1052e7de92e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f15a3709dbdf43efab86e3bed4977095', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:53:15.778693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861cd51-6ab9-4fa8-9684-1052e7de92e5 service swift] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:53:15.778976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861cd51-6ab9-4fa8-9684-1052e7de92e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:53:15.779251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861cd51-6ab9-4fa8-9684-1052e7de92e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:53:15.787139 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861cd51-6ab9-4fa8-9684-1052e7de92e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:53:15.788693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861cd51-6ab9-4fa8-9684-1052e7de92e5 service swift] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:53:15.796938 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1422/2838] 10.222.0.17 () {60 vars in 1384 bytes} [Mon Oct 3 12:53:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 03 12:53:25.734679 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:53:25.793494 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=12 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:24.079418 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52559-1591-4fe1-bd7b-7522cdbb6ac4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:24.090032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52559-1591-4fe1-bd7b-7522cdbb6ac4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:24.094034 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:24.094653 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:24.094940 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:24.095219 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:24.097587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:24.112656 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:24.114156 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:24.125587 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1417/2839] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:25.314816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861cd51-6ab9-4fa8-9684-1052e7de92e5 service swift] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:25.324555 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861cd51-6ab9-4fa8-9684-1052e7de92e5 service swift] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:25.328216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:25.328812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:25.329098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:25.329395 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:25.331174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:25.344630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:25.346098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:25.357601 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1423/2840] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:30.723518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:30.732500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208ab85-5ee9-4525-8906-9e70b9aeabc5 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:30.736152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:30.736746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:30.737025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:30.737300 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:30.739152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:30.806705 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:30.808209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:30.822890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1418/2841] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:33.949952 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:33.952589 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:33.970891 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a9d4f-cd8a-4123-b8fb-4209b78cf034 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:33.977467 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:33.978178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:33.978630 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:33.978918 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:33.980873 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:33.993633 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:33.995288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.008334 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1424/2842] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:34.016110 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:34.018053 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:34.035251 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3ec1d-d96a-4d40-b0b0-e6f50089b4a4 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:34.041005 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:34.041703 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.041998 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.042285 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] PATH_INFO: `/v3/users/357459a31a3a4fedb2af627c317abc2a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.043444 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=357459a31a3a4fedb2af627c317abc2a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:34.045861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.101943 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357459a31a3a4fedb2af627c317abc2a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.109509 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357459a31a3a4fedb2af627c317abc2a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.110343 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357459a31a3a4fedb2af627c317abc2a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.110958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357459a31a3a4fedb2af627c317abc2a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.122775 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-574fe3de-4da2-463d-b44b-6ef5ca325656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357459a31a3a4fedb2af627c317abc2a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.141386 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1419/2843] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:54:34 2022] DELETE /identity/v3/users/357459a31a3a4fedb2af627c317abc2a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:34.317740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:34.328378 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a63246-4cdc-4af8-9ec7-f718f77aedd7 service placement] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:34.390268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:34.390905 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.391187 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.391482 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] PATH_INFO: `/v3/projects/2bd3cb6dc02b419da8d1a25b8ae63fe5` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.392583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd3cb6dc02b419da8d1a25b8ae63fe5)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:34.394728 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.444387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd3cb6dc02b419da8d1a25b8ae63fe5', 'request_id': 'req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.451336 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd3cb6dc02b419da8d1a25b8ae63fe5', 'request_id': 'req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.458240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd3cb6dc02b419da8d1a25b8ae63fe5', 'request_id': 'req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.470511 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] The token cache is being invalidate because project 2bd3cb6dc02b419da8d1a25b8ae63fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:54:34.470876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.471619 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-0c7f793a-f261-48a8-85f1-5a6f986fcc1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:34.473286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1425/2844] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:54:34 2022] DELETE /identity/v3/projects/2bd3cb6dc02b419da8d1a25b8ae63fe5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:34.479496 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1428f5-7ddf-4b60-aa71-98cb7f018cc8 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.479826 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1428f5-7ddf-4b60-aa71-98cb7f018cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.480133 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1428f5-7ddf-4b60-aa71-98cb7f018cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.502301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-7c1428f5-7ddf-4b60-aa71-98cb7f018cc8 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:34.503837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-7c1428f5-7ddf-4b60-aa71-98cb7f018cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:34.553903 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:34.570162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1420/2845] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:34.578280 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73fed-8588-4ec7-8aa0-e2458dcf8a2e None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.578627 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73fed-8588-4ec7-8aa0-e2458dcf8a2e None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.578951 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73fed-8588-4ec7-8aa0-e2458dcf8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.600245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-9af73fed-8588-4ec7-8aa0-e2458dcf8a2e None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:34.601566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-9af73fed-8588-4ec7-8aa0-e2458dcf8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:34.611009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1426/2846] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:34.615754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1428f5-7ddf-4b60-aa71-98cb7f018cc8 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:34.625906 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1428f5-7ddf-4b60-aa71-98cb7f018cc8 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:34.630874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:34.631532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.631773 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.632038 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.632693 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:54:34.632999 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:34.634695 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.647241 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1421/2847] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:54:34.655408 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af73fed-8588-4ec7-8aa0-e2458dcf8a2e None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:34.666343 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af73fed-8588-4ec7-8aa0-e2458dcf8a2e None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:34.671170 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f2320-428d-4c0a-998f-e79da0901713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:34.671770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2320-428d-4c0a-998f-e79da0901713 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.672047 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2320-428d-4c0a-998f-e79da0901713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.672317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2320-428d-4c0a-998f-e79da0901713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.672973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f2320-428d-4c0a-998f-e79da0901713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:34.674888 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f2320-428d-4c0a-998f-e79da0901713 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.714379 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1427/2848] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:54:34 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:54:34.718401 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:34.729188 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a24b9-09b2-498a-97ab-4352e71a373f admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:34.788278 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa873cb3-6661-4bbd-9f88-ce6a898f7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:34.788892 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873cb3-6661-4bbd-9f88-ce6a898f7d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.789865 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873cb3-6661-4bbd-9f88-ce6a898f7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.790216 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa873cb3-6661-4bbd-9f88-ce6a898f7d14 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.790958 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa873cb3-6661-4bbd-9f88-ce6a898f7d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:34.792925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa873cb3-6661-4bbd-9f88-ce6a898f7d14 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.814009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1422/2849] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:54:34 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:54:34.818018 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f2320-428d-4c0a-998f-e79da0901713 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:34.829013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f2320-428d-4c0a-998f-e79da0901713 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:34.833680 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0f483-2b36-469c-9a6b-0dc8c695ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:34.834282 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0f483-2b36-469c-9a6b-0dc8c695ae3e admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.834572 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0f483-2b36-469c-9a6b-0dc8c695ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.834846 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0f483-2b36-469c-9a6b-0dc8c695ae3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.835517 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0f483-2b36-469c-9a6b-0dc8c695ae3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:34.837154 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0f483-2b36-469c-9a6b-0dc8c695ae3e admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.848433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1428/2850] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:54:34.852432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa873cb3-6661-4bbd-9f88-ce6a898f7d14 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:34.862567 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa873cb3-6661-4bbd-9f88-ce6a898f7d14 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:34.867323 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d21b2-7365-49ae-b628-61c9d6136b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:34.867918 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d21b2-7365-49ae-b628-61c9d6136b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.868196 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d21b2-7365-49ae-b628-61c9d6136b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.868469 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d21b2-7365-49ae-b628-61c9d6136b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.869098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d21b2-7365-49ae-b628-61c9d6136b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:34.870716 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d21b2-7365-49ae-b628-61c9d6136b7f admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.881561 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1423/2851] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:54:34.886344 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0f483-2b36-469c-9a6b-0dc8c695ae3e admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:34.897168 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0f483-2b36-469c-9a6b-0dc8c695ae3e admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:34.903219 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:34.903877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.904156 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.904436 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] PATH_INFO: `/v3/projects/b6fdd21753cc44df8a39e9727232e1f1/users/167d84ace1964268a96dce3d0a48388b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.919443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6fdd21753cc44df8a39e9727232e1f1, user_id=167d84ace1964268a96dce3d0a48388b, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:34.922120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:34.931074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:34.944648 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1429/2852] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:54:34 2022] PUT /identity/v3/projects/b6fdd21753cc44df8a39e9727232e1f1/users/167d84ace1964268a96dce3d0a48388b/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:34.948776 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a619-de31-4d85-8441-2ad7b904c495 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:34.948996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a619-de31-4d85-8441-2ad7b904c495 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:34.949279 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a619-de31-4d85-8441-2ad7b904c495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:34.977009 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-f234a619-de31-4d85-8441-2ad7b904c495 None None] MFA Rules not processed for user `167d84ace1964268a96dce3d0a48388b`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:34.978249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f234a619-de31-4d85-8441-2ad7b904c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:35.046127 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1424/2853] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:35.057795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:35.059544 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:35.132642 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba82a92-0cf0-4f62-87b6-eab5651c1491 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:35.138702 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104a97-1102-4344-ba4f-ba24a6320dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589b89539f8d43e993201fab13cd443a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:35.139309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104a97-1102-4344-ba4f-ba24a6320dc0 service nova] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:35.139595 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104a97-1102-4344-ba4f-ba24a6320dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:35.139874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104a97-1102-4344-ba4f-ba24a6320dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:35.147599 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104a97-1102-4344-ba4f-ba24a6320dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:35.149816 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104a97-1102-4344-ba4f-ba24a6320dc0 service nova] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:35.158747 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1430/2854] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:35.362162 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a619-de31-4d85-8441-2ad7b904c495 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:35.410407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:35.425986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a619-de31-4d85-8441-2ad7b904c495 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:35.431184 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:35.431814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:35.432092 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:35.432367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] PATH_INFO: `/v3/users/167d84ace1964268a96dce3d0a48388b` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:35.433529 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167d84ace1964268a96dce3d0a48388b)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:35.435463 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:35.480761 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167d84ace1964268a96dce3d0a48388b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:35.487689 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167d84ace1964268a96dce3d0a48388b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:35.488485 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167d84ace1964268a96dce3d0a48388b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:35.489082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167d84ace1964268a96dce3d0a48388b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:35.496770 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167d84ace1964268a96dce3d0a48388b'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:35.514830 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1425/2855] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:54:35 2022] DELETE /identity/v3/users/167d84ace1964268a96dce3d0a48388b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:35.519319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258147-0968-4232-8a36-c9524bc558cb None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:35.519610 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258147-0968-4232-8a36-c9524bc558cb None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:35.519882 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed258147-0968-4232-8a36-c9524bc558cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:35.538458 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-ed258147-0968-4232-8a36-c9524bc558cb None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:35.539636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ed258147-0968-4232-8a36-c9524bc558cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:35.598165 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1431/2856] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:35.608265 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:35.609714 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:35.667757 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c006974-af4e-47e5-b85e-4fa80bbb8160 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:35.671402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869612f8-b48e-45d9-92ce-3bb5ac72d3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:35.672013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869612f8-b48e-45d9-92ce-3bb5ac72d3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:35.672293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869612f8-b48e-45d9-92ce-3bb5ac72d3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:35.672569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869612f8-b48e-45d9-92ce-3bb5ac72d3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:35.682760 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869612f8-b48e-45d9-92ce-3bb5ac72d3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:35.684440 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869612f8-b48e-45d9-92ce-3bb5ac72d3e5 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:35.697316 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1426/2857] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:35.966397 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed258147-0968-4232-8a36-c9524bc558cb None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:35.967874 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-ed258147-0968-4232-8a36-c9524bc558cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:35.980587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed258147-0968-4232-8a36-c9524bc558cb None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:35.985174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:35.985876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:35.986189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:35.986442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] PATH_INFO: `/v3/projects/b6fdd21753cc44df8a39e9727232e1f1` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:35.987859 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6fdd21753cc44df8a39e9727232e1f1)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:35.989978 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.039444 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6fdd21753cc44df8a39e9727232e1f1', 'request_id': 'req-7f8482bb-ee03-4cd3-abeb-563e2fd68604'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:36.046867 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6fdd21753cc44df8a39e9727232e1f1', 'request_id': 'req-7f8482bb-ee03-4cd3-abeb-563e2fd68604'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:36.053544 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6fdd21753cc44df8a39e9727232e1f1', 'request_id': 'req-7f8482bb-ee03-4cd3-abeb-563e2fd68604'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:36.064442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] The token cache is being invalidate because project b6fdd21753cc44df8a39e9727232e1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:54:36.065049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:36.065855 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-7f8482bb-ee03-4cd3-abeb-563e2fd68604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:36.067067 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1432/2858] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:54:35 2022] DELETE /identity/v3/projects/b6fdd21753cc44df8a39e9727232e1f1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:36.072601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940903-0d1f-4afe-813b-69a969212129 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.073037 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940903-0d1f-4afe-813b-69a969212129 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.073144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940903-0d1f-4afe-813b-69a969212129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.092686 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-09940903-0d1f-4afe-813b-69a969212129 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:36.094054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-09940903-0d1f-4afe-813b-69a969212129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:36.154003 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1427/2859] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:36.161672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739d7e-9997-4266-8f84-d67f6dee2552 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.162009 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739d7e-9997-4266-8f84-d67f6dee2552 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.162236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739d7e-9997-4266-8f84-d67f6dee2552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.182897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-d2739d7e-9997-4266-8f84-d67f6dee2552 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:36.184144 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-d2739d7e-9997-4266-8f84-d67f6dee2552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:36.192198 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1433/2860] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:36.196500 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940903-0d1f-4afe-813b-69a969212129 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.206246 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940903-0d1f-4afe-813b-69a969212129 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.211835 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.212375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.212657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.212932 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.213674 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:54:36.213985 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.215586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.222649 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:36.229296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1428/2861] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:54:36.233713 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739d7e-9997-4266-8f84-d67f6dee2552 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.238121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:36.243988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739d7e-9997-4266-8f84-d67f6dee2552 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.249841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dd278-9478-4862-bacc-6e80ce2cfc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.250457 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd278-9478-4862-bacc-6e80ce2cfc76 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.250737 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd278-9478-4862-bacc-6e80ce2cfc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.251015 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd278-9478-4862-bacc-6e80ce2cfc76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.251665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dd278-9478-4862-bacc-6e80ce2cfc76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.253863 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dd278-9478-4862-bacc-6e80ce2cfc76 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.281503 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1434/2862] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:54:36 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:54:36.286379 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.297262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645d9fc-a8f9-46f4-be89-0dc673e03238 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.355595 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262922a6-05fd-41a6-abd2-eb1995b278c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.356249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262922a6-05fd-41a6-abd2-eb1995b278c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.356533 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262922a6-05fd-41a6-abd2-eb1995b278c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.356847 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262922a6-05fd-41a6-abd2-eb1995b278c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.357499 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262922a6-05fd-41a6-abd2-eb1995b278c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.359460 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262922a6-05fd-41a6-abd2-eb1995b278c6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.381616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1429/2863] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:54:36 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:54:36.385795 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dd278-9478-4862-bacc-6e80ce2cfc76 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.396002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dd278-9478-4862-bacc-6e80ce2cfc76 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.400697 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8769e0-f8e8-4df3-8aa9-a2334bd7bc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.401299 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8769e0-f8e8-4df3-8aa9-a2334bd7bc13 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.401616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8769e0-f8e8-4df3-8aa9-a2334bd7bc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.401898 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8769e0-f8e8-4df3-8aa9-a2334bd7bc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.402541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8769e0-f8e8-4df3-8aa9-a2334bd7bc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.404158 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8769e0-f8e8-4df3-8aa9-a2334bd7bc13 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.414604 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1435/2864] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:54:36.418812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262922a6-05fd-41a6-abd2-eb1995b278c6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.430542 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262922a6-05fd-41a6-abd2-eb1995b278c6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.435324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c605e7-7517-4b90-b1ef-f848acef7f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.435920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c605e7-7517-4b90-b1ef-f848acef7f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.436201 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c605e7-7517-4b90-b1ef-f848acef7f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.436475 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c605e7-7517-4b90-b1ef-f848acef7f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.437139 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c605e7-7517-4b90-b1ef-f848acef7f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.438794 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c605e7-7517-4b90-b1ef-f848acef7f57 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.448805 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1430/2865] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:54:36.452727 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8769e0-f8e8-4df3-8aa9-a2334bd7bc13 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.462746 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8769e0-f8e8-4df3-8aa9-a2334bd7bc13 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.467525 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc88e-1e64-42bc-8af4-f06a66651f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.468176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc88e-1e64-42bc-8af4-f06a66651f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.468489 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc88e-1e64-42bc-8af4-f06a66651f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.468763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fc88e-1e64-42bc-8af4-f06a66651f02 admin admin] PATH_INFO: `/v3/projects/902101fcefb74f67af99cf4fec0bd79b/users/dc1172dbd5cd4037b920b83f4247681f/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.484069 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fc88e-1e64-42bc-8af4-f06a66651f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902101fcefb74f67af99cf4fec0bd79b, user_id=dc1172dbd5cd4037b920b83f4247681f, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.486740 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fc88e-1e64-42bc-8af4-f06a66651f02 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.501013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1436/2866] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:54:36 2022] PUT /identity/v3/projects/902101fcefb74f67af99cf4fec0bd79b/users/dc1172dbd5cd4037b920b83f4247681f/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:36.511789 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5daaf-3535-447f-b822-c474d5113907 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.512094 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5daaf-3535-447f-b822-c474d5113907 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.512374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5daaf-3535-447f-b822-c474d5113907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.541327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-edc5daaf-3535-447f-b822-c474d5113907 None None] MFA Rules not processed for user `dc1172dbd5cd4037b920b83f4247681f`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:36.542583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-edc5daaf-3535-447f-b822-c474d5113907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:36.608616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1431/2867] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:36.613186 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc88e-1e64-42bc-8af4-f06a66651f02 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.676355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fc88e-1e64-42bc-8af4-f06a66651f02 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.681948 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc452e-c92e-42ad-a0c5-f291c4f9ec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.682570 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc452e-c92e-42ad-a0c5-f291c4f9ec58 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.682853 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc452e-c92e-42ad-a0c5-f291c4f9ec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.683126 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc452e-c92e-42ad-a0c5-f291c4f9ec58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.684064 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc452e-c92e-42ad-a0c5-f291c4f9ec58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.686562 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc452e-c92e-42ad-a0c5-f291c4f9ec58 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.715784 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1437/2868] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:54:36 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:54:36.719976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5daaf-3535-447f-b822-c474d5113907 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.732069 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5daaf-3535-447f-b822-c474d5113907 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.795448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184fa3-ad00-4ca8-b988-a76c00b77ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.796066 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184fa3-ad00-4ca8-b988-a76c00b77ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.796353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184fa3-ad00-4ca8-b988-a76c00b77ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.796633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40184fa3-ad00-4ca8-b988-a76c00b77ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.797284 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40184fa3-ad00-4ca8-b988-a76c00b77ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.799247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40184fa3-ad00-4ca8-b988-a76c00b77ca5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.810470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:36.822513 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1432/2869] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:54:36 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:54:36.826693 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc452e-c92e-42ad-a0c5-f291c4f9ec58 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.837574 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc452e-c92e-42ad-a0c5-f291c4f9ec58 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.842349 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee76287-23dd-45c7-a0c0-e5cc68b9a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.842972 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee76287-23dd-45c7-a0c0-e5cc68b9a803 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.843251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee76287-23dd-45c7-a0c0-e5cc68b9a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.843535 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee76287-23dd-45c7-a0c0-e5cc68b9a803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.844176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee76287-23dd-45c7-a0c0-e5cc68b9a803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.845814 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee76287-23dd-45c7-a0c0-e5cc68b9a803 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.858291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1438/2870] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:54:36.862568 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184fa3-ad00-4ca8-b988-a76c00b77ca5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.873238 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40184fa3-ad00-4ca8-b988-a76c00b77ca5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:36.878086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda6f3-0275-4fea-b43c-a391460d77a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:36.879008 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda6f3-0275-4fea-b43c-a391460d77a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:36.879291 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda6f3-0275-4fea-b43c-a391460d77a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:36.879569 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbda6f3-0275-4fea-b43c-a391460d77a5 admin admin] PATH_INFO: `/v3/projects/93a235b52a6a4c19a908a3819d762c03/users/ba2220aae72945509b15681a512147f0/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:36.902275 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda6f3-0275-4fea-b43c-a391460d77a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a235b52a6a4c19a908a3819d762c03, user_id=ba2220aae72945509b15681a512147f0, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:36.905013 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbda6f3-0275-4fea-b43c-a391460d77a5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:36.922050 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1433/2871] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:54:36 2022] PUT /identity/v3/projects/93a235b52a6a4c19a908a3819d762c03/users/ba2220aae72945509b15681a512147f0/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:54:36.926775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee76287-23dd-45c7-a0c0-e5cc68b9a803 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:36.943839 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee76287-23dd-45c7-a0c0-e5cc68b9a803 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:37.004508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07c170-0960-43b6-9293-cec105355d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:37.005040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c170-0960-43b6-9293-cec105355d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:37.005325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c170-0960-43b6-9293-cec105355d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:37.005635 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c170-0960-43b6-9293-cec105355d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:37.006315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c170-0960-43b6-9293-cec105355d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:37.007925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c170-0960-43b6-9293-cec105355d21 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:37.019922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1439/2872] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:54:37.024432 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda6f3-0275-4fea-b43c-a391460d77a5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:37.034862 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbda6f3-0275-4fea-b43c-a391460d77a5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:37.040131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:37.040780 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:37.041054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:37.041327 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] PATH_INFO: `/v3/projects/93a235b52a6a4c19a908a3819d762c03/users/ba2220aae72945509b15681a512147f0/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:37.043301 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a235b52a6a4c19a908a3819d762c03, user_id=ba2220aae72945509b15681a512147f0, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:37.045973 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:37.056616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1434/2873] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:54:37 2022] PUT /identity/v3/projects/93a235b52a6a4c19a908a3819d762c03/users/ba2220aae72945509b15681a512147f0/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:37.068075 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d09df-ee88-4fee-945b-0c7060cf0ce2 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:37.068607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d09df-ee88-4fee-945b-0c7060cf0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:37.068607 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d09df-ee88-4fee-945b-0c7060cf0ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:37.101294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7e4d09df-ee88-4fee-945b-0c7060cf0ce2 None None] MFA Rules not processed for user `ba2220aae72945509b15681a512147f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:37.102551 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7e4d09df-ee88-4fee-945b-0c7060cf0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:37.106533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:37.171887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1440/2874] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:37.183288 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:37.185081 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:37.242709 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702595b4-9413-4f57-8050-0f4e7db151ae admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:37.246394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afea6cf-e096-476f-abc4-afacee9a1ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:37.246987 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea6cf-e096-476f-abc4-afacee9a1ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:37.247264 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea6cf-e096-476f-abc4-afacee9a1ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:37.247532 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea6cf-e096-476f-abc4-afacee9a1ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:37.306599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afea6cf-e096-476f-abc4-afacee9a1ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:37.308077 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afea6cf-e096-476f-abc4-afacee9a1ec7 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:37.317741 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1435/2875] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:38.702786 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d09df-ee88-4fee-945b-0c7060cf0ce2 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:38.704268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7e4d09df-ee88-4fee-945b-0c7060cf0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:38.716268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d09df-ee88-4fee-945b-0c7060cf0ce2 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:38.721216 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a16f2-47cc-42ca-a4c2-cbc34cfea01e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:38.721848 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a16f2-47cc-42ca-a4c2-cbc34cfea01e service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:38.722123 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a16f2-47cc-42ca-a4c2-cbc34cfea01e service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:38.722393 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a16f2-47cc-42ca-a4c2-cbc34cfea01e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:38.731982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a16f2-47cc-42ca-a4c2-cbc34cfea01e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:38.733414 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a16f2-47cc-42ca-a4c2-cbc34cfea01e service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:38.743753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1441/2876] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:42.527025 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afea6cf-e096-476f-abc4-afacee9a1ec7 service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:42.588564 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afea6cf-e096-476f-abc4-afacee9a1ec7 service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:42.593334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:42.593991 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:42.594277 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:42.594555 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] PATH_INFO: `/v3/users/dc1172dbd5cd4037b920b83f4247681f` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:42.595729 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1172dbd5cd4037b920b83f4247681f)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:42.597696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:42.611260 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:42.645860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1172dbd5cd4037b920b83f4247681f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:42.653375 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1172dbd5cd4037b920b83f4247681f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:42.654203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1172dbd5cd4037b920b83f4247681f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:42.654813 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1172dbd5cd4037b920b83f4247681f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:42.662600 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1172dbd5cd4037b920b83f4247681f'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:42.681149 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1436/2877] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:54:42 2022] DELETE /identity/v3/users/dc1172dbd5cd4037b920b83f4247681f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:42.686203 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965196-60ea-42a3-ada6-210918762315 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:42.686984 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965196-60ea-42a3-ada6-210918762315 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:42.687109 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965196-60ea-42a3-ada6-210918762315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:42.710528 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a1965196-60ea-42a3-ada6-210918762315 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:42.711733 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a1965196-60ea-42a3-ada6-210918762315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:42.778732 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1442/2878] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:42.788355 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:42.789837 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:42.854528 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240202b-6f0b-4ea0-97be-a127c4d207b6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:42.858249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630ac3-2de0-4cce-a263-9ba82dd5a730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:42.858856 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630ac3-2de0-4cce-a263-9ba82dd5a730 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:42.859137 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630ac3-2de0-4cce-a263-9ba82dd5a730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:42.859412 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630ac3-2de0-4cce-a263-9ba82dd5a730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:42.869147 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2630ac3-2de0-4cce-a263-9ba82dd5a730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:42.870613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2630ac3-2de0-4cce-a263-9ba82dd5a730 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:42.880305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1437/2879] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:43.164291 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1965196-60ea-42a3-ada6-210918762315 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:43.165801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a1965196-60ea-42a3-ada6-210918762315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:43.178240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1965196-60ea-42a3-ada6-210918762315 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:43.183568 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:43.184217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:43.184500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:43.184775 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] PATH_INFO: `/v3/projects/902101fcefb74f67af99cf4fec0bd79b` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:43.185953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] RBAC: Authorizing `identity:delete_project(project_id=902101fcefb74f67af99cf4fec0bd79b)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:43.187875 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:43.236930 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902101fcefb74f67af99cf4fec0bd79b', 'request_id': 'req-612eb0f4-0040-4025-aae7-33a34c52923f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.245425 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902101fcefb74f67af99cf4fec0bd79b', 'request_id': 'req-612eb0f4-0040-4025-aae7-33a34c52923f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.252086 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902101fcefb74f67af99cf4fec0bd79b', 'request_id': 'req-612eb0f4-0040-4025-aae7-33a34c52923f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.263710 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] The token cache is being invalidate because project 902101fcefb74f67af99cf4fec0bd79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:54:43.264001 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.264694 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.266232 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1443/2880] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:54:43 2022] DELETE /identity/v3/projects/902101fcefb74f67af99cf4fec0bd79b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:43.270891 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630ac3-2de0-4cce-a263-9ba82dd5a730 service neutron] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:43.281239 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630ac3-2de0-4cce-a263-9ba82dd5a730 service neutron] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:43.340032 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:43.340661 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:43.340944 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:43.341223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] PATH_INFO: `/v3/users/ba2220aae72945509b15681a512147f0` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:43.342402 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2220aae72945509b15681a512147f0)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:43.344334 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:43.383206 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:43.393293 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2220aae72945509b15681a512147f0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.400644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2220aae72945509b15681a512147f0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.401321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2220aae72945509b15681a512147f0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.401974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2220aae72945509b15681a512147f0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.409381 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-c2e6c26d-5b28-42d1-b292-c0712d24a928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2220aae72945509b15681a512147f0'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.427467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1438/2881] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:54:43 2022] DELETE /identity/v3/users/ba2220aae72945509b15681a512147f0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:43.713780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:43.715317 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:43.730027 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eb0f4-0040-4025-aae7-33a34c52923f admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:43.738372 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:43.792620 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:43.793256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:43.793558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:43.793845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] PATH_INFO: `/v3/projects/93a235b52a6a4c19a908a3819d762c03` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:43.794961 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a235b52a6a4c19a908a3819d762c03)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:43.796850 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:43.845559 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a235b52a6a4c19a908a3819d762c03', 'request_id': 'req-ff6cd82d-f53a-487b-9372-063d3af36e3f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.853002 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a235b52a6a4c19a908a3819d762c03', 'request_id': 'req-ff6cd82d-f53a-487b-9372-063d3af36e3f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.859636 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a235b52a6a4c19a908a3819d762c03', 'request_id': 'req-ff6cd82d-f53a-487b-9372-063d3af36e3f'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.870274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] The token cache is being invalidate because project 93a235b52a6a4c19a908a3819d762c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:54:43.870566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.871217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-ff6cd82d-f53a-487b-9372-063d3af36e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:54:43.872701 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1444/2882] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:54:43 2022] DELETE /identity/v3/projects/93a235b52a6a4c19a908a3819d762c03 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:54:43.877644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eacd3f-e1af-45be-9647-bddee4555d31 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:43.878112 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eacd3f-e1af-45be-9647-bddee4555d31 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:43.878230 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eacd3f-e1af-45be-9647-bddee4555d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:43.898599 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e7eacd3f-e1af-45be-9647-bddee4555d31 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:43.899833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e7eacd3f-e1af-45be-9647-bddee4555d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:43.962146 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1439/2883] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:43.970090 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2868d-e3f7-405d-9ba9-936a0050e416 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:43.970376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2868d-e3f7-405d-9ba9-936a0050e416 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:43.970651 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2868d-e3f7-405d-9ba9-936a0050e416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:43.991387 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c3b2868d-e3f7-405d-9ba9-936a0050e416 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:43.993210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c3b2868d-e3f7-405d-9ba9-936a0050e416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:44.001439 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1445/2884] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:44.006096 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eacd3f-e1af-45be-9647-bddee4555d31 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:44.016606 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eacd3f-e1af-45be-9647-bddee4555d31 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:44.025208 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:44.026154 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:44.026414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:44.026762 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:44.027636 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:54:44.028098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:44.029670 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:44.044937 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1440/2885] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:54:44.049796 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2868d-e3f7-405d-9ba9-936a0050e416 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:44.061626 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2868d-e3f7-405d-9ba9-936a0050e416 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:44.066801 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f3271-1b90-4302-ab91-28769bad28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:44.067442 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f3271-1b90-4302-ab91-28769bad28d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:44.067686 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f3271-1b90-4302-ab91-28769bad28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:44.067957 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f3271-1b90-4302-ab91-28769bad28d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:44.068596 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f3271-1b90-4302-ab91-28769bad28d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:44.070541 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f3271-1b90-4302-ab91-28769bad28d9 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:44.105355 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1446/2886] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:54:44 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 03 12:54:44.109816 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:44.121086 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc23346-dafa-4090-b61f-f43d77645ac3 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:44.176819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae3f6-6d3f-4702-827b-6e130c85bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:44.177424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae3f6-6d3f-4702-827b-6e130c85bef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:44.177742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae3f6-6d3f-4702-827b-6e130c85bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:44.178021 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ae3f6-6d3f-4702-827b-6e130c85bef6 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:44.178680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ae3f6-6d3f-4702-827b-6e130c85bef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:44.181202 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ae3f6-6d3f-4702-827b-6e130c85bef6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:44.202015 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1441/2887] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:54:44 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:54:44.206461 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f3271-1b90-4302-ab91-28769bad28d9 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:44.217176 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f3271-1b90-4302-ab91-28769bad28d9 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:44.221904 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea5c20-570d-4900-9d9d-1e3b9b0b2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:44.222484 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea5c20-570d-4900-9d9d-1e3b9b0b2d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:44.222767 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea5c20-570d-4900-9d9d-1e3b9b0b2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:44.223058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea5c20-570d-4900-9d9d-1e3b9b0b2d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:44.223685 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea5c20-570d-4900-9d9d-1e3b9b0b2d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:44.225265 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea5c20-570d-4900-9d9d-1e3b9b0b2d01 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:44.236825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1447/2888] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:54:44.240725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae3f6-6d3f-4702-827b-6e130c85bef6 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:44.251088 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ae3f6-6d3f-4702-827b-6e130c85bef6 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:44.255915 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45088bfb-0f4d-4772-bf94-4013609710a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:44.256507 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45088bfb-0f4d-4772-bf94-4013609710a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:44.256788 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45088bfb-0f4d-4772-bf94-4013609710a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:44.257063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45088bfb-0f4d-4772-bf94-4013609710a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:44.257727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45088bfb-0f4d-4772-bf94-4013609710a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:44.259326 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45088bfb-0f4d-4772-bf94-4013609710a6 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:44.269873 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1442/2889] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:54:44.274521 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea5c20-570d-4900-9d9d-1e3b9b0b2d01 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:44.284587 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea5c20-570d-4900-9d9d-1e3b9b0b2d01 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:44.290770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:44.291445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:44.291730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:44.292005 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] PATH_INFO: `/v3/projects/1c4f17ef5ef447b595f257c79cbcaeba/users/75fd12c3326e4571814df2f79511833a/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:44.307552 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4f17ef5ef447b595f257c79cbcaeba, user_id=75fd12c3326e4571814df2f79511833a, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:44.310245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:44.323404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1448/2890] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:54:44 2022] PUT /identity/v3/projects/1c4f17ef5ef447b595f257c79cbcaeba/users/75fd12c3326e4571814df2f79511833a/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:54:44.335348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31b08-3809-4e83-bda4-6e9b1a6fe907 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:44.336116 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31b08-3809-4e83-bda4-6e9b1a6fe907 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:44.336391 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a31b08-3809-4e83-bda4-6e9b1a6fe907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:44.365330 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-96a31b08-3809-4e83-bda4-6e9b1a6fe907 None None] MFA Rules not processed for user `75fd12c3326e4571814df2f79511833a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:54:44.366514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-96a31b08-3809-4e83-bda4-6e9b1a6fe907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:44.389366 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:44.454150 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1443/2891] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:54:44.466315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:54:44.468056 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:54:44.515531 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:44.533624 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84d599-8180-4f61-a7f2-cd69bdab54d1 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:54:44.537443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f0c50-4e89-4c3d-a428-98017e091d51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd676c76b05924c4ab06940f04996fa3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:54:44.538117 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0c50-4e89-4c3d-a428-98017e091d51 service glance] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:54:44.538428 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0c50-4e89-4c3d-a428-98017e091d51 service glance] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:54:44.538748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f0c50-4e89-4c3d-a428-98017e091d51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:54:44.548422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0c50-4e89-4c3d-a428-98017e091d51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:54:44.549897 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f0c50-4e89-4c3d-a428-98017e091d51 service glance] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:54:44.559346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1449/2892] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:54:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:54:54.451107 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=23 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:54:54.555019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=9 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:03.396227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a31b08-3809-4e83-bda4-6e9b1a6fe907 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:03.462712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a31b08-3809-4e83-bda4-6e9b1a6fe907 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:03.467503 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:03.468144 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:03.468421 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:03.468708 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] PATH_INFO: `/v3/users/75fd12c3326e4571814df2f79511833a` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:03.469896 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fd12c3326e4571814df2f79511833a)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:03.471887 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:03.516608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fd12c3326e4571814df2f79511833a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:03.524447 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fd12c3326e4571814df2f79511833a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:03.525118 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fd12c3326e4571814df2f79511833a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:03.525755 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fd12c3326e4571814df2f79511833a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:03.533313 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fd12c3326e4571814df2f79511833a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:03.550487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1444/2893] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:55:03 2022] DELETE /identity/v3/users/75fd12c3326e4571814df2f79511833a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:03.555093 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e9e7-cc05-4196-bbae-9b35b525155b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:03.555566 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e9e7-cc05-4196-bbae-9b35b525155b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:03.555668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682e9e7-cc05-4196-bbae-9b35b525155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:03.574986 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8682e9e7-cc05-4196-bbae-9b35b525155b None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:03.576192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8682e9e7-cc05-4196-bbae-9b35b525155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:03.635325 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1450/2894] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:03.645287 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:03.646727 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:03.706060 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32780f0d-533d-41d4-9e63-052d746c2abc admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:03.709923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d8e39-ad53-4460-bc7b-2fbe0d1d12b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:03.710535 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8e39-ad53-4460-bc7b-2fbe0d1d12b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:03.710823 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8e39-ad53-4460-bc7b-2fbe0d1d12b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:03.711098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d8e39-ad53-4460-bc7b-2fbe0d1d12b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:03.720688 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d8e39-ad53-4460-bc7b-2fbe0d1d12b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:03.722175 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d8e39-ad53-4460-bc7b-2fbe0d1d12b8 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:03.731665 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1445/2895] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:04.011802 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682e9e7-cc05-4196-bbae-9b35b525155b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.011994 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8682e9e7-cc05-4196-bbae-9b35b525155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:04.026013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682e9e7-cc05-4196-bbae-9b35b525155b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.037739 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.038976 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.039401 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.039678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] PATH_INFO: `/v3/projects/1c4f17ef5ef447b595f257c79cbcaeba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.041432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4f17ef5ef447b595f257c79cbcaeba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.043578 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.091305 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4f17ef5ef447b595f257c79cbcaeba', 'request_id': 'req-760ecc47-c9aa-421f-9311-1ca9c991b522'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.098209 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4f17ef5ef447b595f257c79cbcaeba', 'request_id': 'req-760ecc47-c9aa-421f-9311-1ca9c991b522'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.104755 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4f17ef5ef447b595f257c79cbcaeba', 'request_id': 'req-760ecc47-c9aa-421f-9311-1ca9c991b522'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.115161 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] The token cache is being invalidate because project 1c4f17ef5ef447b595f257c79cbcaeba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:55:04.115450 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.116078 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-760ecc47-c9aa-421f-9311-1ca9c991b522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.117611 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1451/2896] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:55:04 2022] DELETE /identity/v3/projects/1c4f17ef5ef447b595f257c79cbcaeba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:55:04.122461 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54583-6af6-469b-bcad-906f8669cd01 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.122798 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54583-6af6-469b-bcad-906f8669cd01 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.123074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd54583-6af6-469b-bcad-906f8669cd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.143367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-fbd54583-6af6-469b-bcad-906f8669cd01 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:04.144870 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-fbd54583-6af6-469b-bcad-906f8669cd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:04.163498 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:04.207524 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1446/2897] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:55:04.215415 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abbb3a-1afc-461c-bb51-e579849bcfac None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.215756 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abbb3a-1afc-461c-bb51-e579849bcfac None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.216099 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abbb3a-1afc-461c-bb51-e579849bcfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.235558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-64abbb3a-1afc-461c-bb51-e579849bcfac None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:04.236842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-64abbb3a-1afc-461c-bb51-e579849bcfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:04.244661 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1452/2898] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:04.248927 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54583-6af6-469b-bcad-906f8669cd01 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.259273 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd54583-6af6-469b-bcad-906f8669cd01 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.263880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.264470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.264746 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.265020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.265696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:55:04.266000 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.267602 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.279706 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1447/2899] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:55:04.283987 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abbb3a-1afc-461c-bb51-e579849bcfac None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.293058 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abbb3a-1afc-461c-bb51-e579849bcfac None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.299427 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ffcf3-2b1f-4f26-8ad4-29f20a3c132d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.300217 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ffcf3-2b1f-4f26-8ad4-29f20a3c132d admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.300505 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ffcf3-2b1f-4f26-8ad4-29f20a3c132d admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.300913 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ffcf3-2b1f-4f26-8ad4-29f20a3c132d admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.301720 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ffcf3-2b1f-4f26-8ad4-29f20a3c132d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.303742 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ffcf3-2b1f-4f26-8ad4-29f20a3c132d admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.331134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1453/2900] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:55:04 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:04.335967 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.346041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd815688-1b7e-44ac-bf23-b249b413106d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.406933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3c7ff-205d-4869-a868-9ebd8e656729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.407611 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c7ff-205d-4869-a868-9ebd8e656729 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.407809 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c7ff-205d-4869-a868-9ebd8e656729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.408083 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c7ff-205d-4869-a868-9ebd8e656729 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.408730 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3c7ff-205d-4869-a868-9ebd8e656729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.410700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3c7ff-205d-4869-a868-9ebd8e656729 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.434878 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1448/2901] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:55:04 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:04.439368 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ffcf3-2b1f-4f26-8ad4-29f20a3c132d admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.450647 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ffcf3-2b1f-4f26-8ad4-29f20a3c132d admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.455430 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf984c-2c7d-467a-90cb-5f2c5d6251f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.456040 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf984c-2c7d-467a-90cb-5f2c5d6251f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.456320 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf984c-2c7d-467a-90cb-5f2c5d6251f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.456597 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf984c-2c7d-467a-90cb-5f2c5d6251f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.457281 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf984c-2c7d-467a-90cb-5f2c5d6251f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.458993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf984c-2c7d-467a-90cb-5f2c5d6251f2 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.469294 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1454/2902] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:55:04.473466 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3c7ff-205d-4869-a868-9ebd8e656729 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.483819 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3c7ff-205d-4869-a868-9ebd8e656729 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.488449 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcffd2-777f-4d62-b995-f857a6b5a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.489042 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcffd2-777f-4d62-b995-f857a6b5a36d admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.489318 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcffd2-777f-4d62-b995-f857a6b5a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.489623 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcffd2-777f-4d62-b995-f857a6b5a36d admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.490257 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcffd2-777f-4d62-b995-f857a6b5a36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.492385 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adcffd2-777f-4d62-b995-f857a6b5a36d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.502205 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1449/2903] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:55:04.507516 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf984c-2c7d-467a-90cb-5f2c5d6251f2 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.517189 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf984c-2c7d-467a-90cb-5f2c5d6251f2 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.522362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.523021 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.523310 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.523588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] PATH_INFO: `/v3/projects/a4f8809fa94c414faa483ba69b81f989/users/4f9d6a01d5f741199e00c467257ff6f7/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.538270 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f8809fa94c414faa483ba69b81f989, user_id=4f9d6a01d5f741199e00c467257ff6f7, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.540922 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.554346 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1455/2904] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:55:04 2022] PUT /identity/v3/projects/a4f8809fa94c414faa483ba69b81f989/users/4f9d6a01d5f741199e00c467257ff6f7/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:04.564373 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8247-ba1d-4114-a76b-86ba6be86360 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.564700 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8247-ba1d-4114-a76b-86ba6be86360 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.565040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec8247-ba1d-4114-a76b-86ba6be86360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.594384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-adec8247-ba1d-4114-a76b-86ba6be86360 None None] MFA Rules not processed for user `4f9d6a01d5f741199e00c467257ff6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:04.595601 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-adec8247-ba1d-4114-a76b-86ba6be86360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:04.661638 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1450/2905] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:04.696877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.698725 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:04.720446 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:04.761366 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f689bd-f165-44e3-91b6-60b85154760c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.765341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107173fd-2ba3-40b0-8acc-6391783ab9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.765990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107173fd-2ba3-40b0-8acc-6391783ab9ad service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.766271 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107173fd-2ba3-40b0-8acc-6391783ab9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.766548 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107173fd-2ba3-40b0-8acc-6391783ab9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.775351 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107173fd-2ba3-40b0-8acc-6391783ab9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.776766 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107173fd-2ba3-40b0-8acc-6391783ab9ad service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.785765 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1456/2906] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:04.801336 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8247-ba1d-4114-a76b-86ba6be86360 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:04.821810 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:04.866505 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec8247-ba1d-4114-a76b-86ba6be86360 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:04.871074 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:04.871696 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.871974 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.872247 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] PATH_INFO: `/v3/users/4f9d6a01d5f741199e00c467257ff6f7` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.873368 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9d6a01d5f741199e00c467257ff6f7)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:04.875321 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:04.922583 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9d6a01d5f741199e00c467257ff6f7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.931439 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9d6a01d5f741199e00c467257ff6f7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.932119 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9d6a01d5f741199e00c467257ff6f7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.932735 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9d6a01d5f741199e00c467257ff6f7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.940633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9d6a01d5f741199e00c467257ff6f7'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:04.957784 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1451/2907] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:55:04 2022] DELETE /identity/v3/users/4f9d6a01d5f741199e00c467257ff6f7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:04.962371 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e963e-2297-466d-b6b7-5476b5de7419 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:04.962663 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e963e-2297-466d-b6b7-5476b5de7419 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:04.962943 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e963e-2297-466d-b6b7-5476b5de7419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:04.982608 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-7e2e963e-2297-466d-b6b7-5476b5de7419 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:04.983762 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7e2e963e-2297-466d-b6b7-5476b5de7419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:05.042736 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1457/2908] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:05.052986 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:05.055097 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:05.113754 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05312d89-5a48-400b-9cd3-27df84bd7edc admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:05.118062 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f703ea5-ff64-464f-8d87-2190d7c88569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:05.118680 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f703ea5-ff64-464f-8d87-2190d7c88569 service neutron] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.118970 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f703ea5-ff64-464f-8d87-2190d7c88569 service neutron] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.119250 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f703ea5-ff64-464f-8d87-2190d7c88569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.135450 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f703ea5-ff64-464f-8d87-2190d7c88569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:05.136921 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f703ea5-ff64-464f-8d87-2190d7c88569 service neutron] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:05.147923 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1452/2909] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:05.427843 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e963e-2297-466d-b6b7-5476b5de7419 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:05.430155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-7e2e963e-2297-466d-b6b7-5476b5de7419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:05.446265 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e963e-2297-466d-b6b7-5476b5de7419 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:05.451231 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:05.452098 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.452384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.452817 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] PATH_INFO: `/v3/projects/a4f8809fa94c414faa483ba69b81f989` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.454095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4f8809fa94c414faa483ba69b81f989)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:05.456068 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:05.505420 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f8809fa94c414faa483ba69b81f989', 'request_id': 'req-898b2065-6a3c-4918-9156-7069969d8b8b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:05.512763 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f8809fa94c414faa483ba69b81f989', 'request_id': 'req-898b2065-6a3c-4918-9156-7069969d8b8b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:05.519536 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f8809fa94c414faa483ba69b81f989', 'request_id': 'req-898b2065-6a3c-4918-9156-7069969d8b8b'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:05.530534 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] The token cache is being invalidate because project a4f8809fa94c414faa483ba69b81f989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:55:05.530828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:05.531481 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-898b2065-6a3c-4918-9156-7069969d8b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:05.532971 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1458/2910] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:55:05 2022] DELETE /identity/v3/projects/a4f8809fa94c414faa483ba69b81f989 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:05.538791 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b248ab-b23c-4190-b005-12d9108b7111 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.539294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b248ab-b23c-4190-b005-12d9108b7111 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.539394 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b248ab-b23c-4190-b005-12d9108b7111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.559389 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e0b248ab-b23c-4190-b005-12d9108b7111 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:05.560796 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e0b248ab-b23c-4190-b005-12d9108b7111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:05.596876 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:05.624317 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1453/2911] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 03 12:55:05.634850 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e3d0-4555-4c95-a708-ac3167bf95f7 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.635136 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e3d0-4555-4c95-a708-ac3167bf95f7 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.635411 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009e3d0-4555-4c95-a708-ac3167bf95f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.657114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-8009e3d0-4555-4c95-a708-ac3167bf95f7 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:05.658443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-8009e3d0-4555-4c95-a708-ac3167bf95f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:05.666877 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1459/2912] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:05.671292 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b248ab-b23c-4190-b005-12d9108b7111 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:05.681047 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b248ab-b23c-4190-b005-12d9108b7111 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:05.686131 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:05.686833 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.687148 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.687396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.688244 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:55:05.688559 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:05.690530 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:05.703898 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1454/2913] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 03 12:55:05.708396 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009e3d0-4555-4c95-a708-ac3167bf95f7 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:05.718678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009e3d0-4555-4c95-a708-ac3167bf95f7 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:05.723285 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7729ef-5773-4ea7-9e6c-a5987eb0bbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:05.723890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7729ef-5773-4ea7-9e6c-a5987eb0bbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.724167 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7729ef-5773-4ea7-9e6c-a5987eb0bbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.724440 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7729ef-5773-4ea7-9e6c-a5987eb0bbb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.725076 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7729ef-5773-4ea7-9e6c-a5987eb0bbb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:05.726990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7729ef-5773-4ea7-9e6c-a5987eb0bbb5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:05.755953 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1460/2914] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:55:05 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:05.760719 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:05.771644 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0679ed-9c34-43f1-96e7-d3c31fe5d445 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:05.830628 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee9d2e-702c-47af-babb-ba095a963bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:05.831759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9d2e-702c-47af-babb-ba095a963bee admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.831759 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9d2e-702c-47af-babb-ba095a963bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.832007 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee9d2e-702c-47af-babb-ba095a963bee admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.832484 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee9d2e-702c-47af-babb-ba095a963bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:05.834518 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee9d2e-702c-47af-babb-ba095a963bee admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:05.857477 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1455/2915] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:55:05 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:05.861990 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7729ef-5773-4ea7-9e6c-a5987eb0bbb5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:05.872330 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7729ef-5773-4ea7-9e6c-a5987eb0bbb5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:05.877290 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9252a4-86b6-4020-b430-5d8f62da9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:05.878178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9252a4-86b6-4020-b430-5d8f62da9f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.878473 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9252a4-86b6-4020-b430-5d8f62da9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.878779 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9252a4-86b6-4020-b430-5d8f62da9f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.879433 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9252a4-86b6-4020-b430-5d8f62da9f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:05.881061 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9252a4-86b6-4020-b430-5d8f62da9f34 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:05.891962 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1461/2916] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:55:05.896453 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee9d2e-702c-47af-babb-ba095a963bee admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:05.907860 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee9d2e-702c-47af-babb-ba095a963bee admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:05.912678 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f8b5-0488-4405-baed-c5818b039a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:05.913298 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f8b5-0488-4405-baed-c5818b039a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.913620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f8b5-0488-4405-baed-c5818b039a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.913899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f8b5-0488-4405-baed-c5818b039a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.914548 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7f8b5-0488-4405-baed-c5818b039a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:05.916165 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7f8b5-0488-4405-baed-c5818b039a11 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:05.927416 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1456/2917] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:55:05.932672 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9252a4-86b6-4020-b430-5d8f62da9f34 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:05.943121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9252a4-86b6-4020-b430-5d8f62da9f34 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:05.948982 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049b1ba-08c7-4363-9426-02bdd9cb31f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:05.949861 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b1ba-08c7-4363-9426-02bdd9cb31f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.950145 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b1ba-08c7-4363-9426-02bdd9cb31f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.950422 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049b1ba-08c7-4363-9426-02bdd9cb31f4 admin admin] PATH_INFO: `/v3/projects/7b3eca506c6547b582bc5585c3dac56f/users/ab23179a0de54f999cf0fdc19b298cb3/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:05.952825 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:05.968526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049b1ba-08c7-4363-9426-02bdd9cb31f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3eca506c6547b582bc5585c3dac56f, user_id=ab23179a0de54f999cf0fdc19b298cb3, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:05.971331 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049b1ba-08c7-4363-9426-02bdd9cb31f4 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:05.984340 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1462/2918] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:55:05 2022] PUT /identity/v3/projects/7b3eca506c6547b582bc5585c3dac56f/users/ab23179a0de54f999cf0fdc19b298cb3/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:05.995594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ed0-7c9c-40b0-809b-6f195507f9b8 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:05.995890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ed0-7c9c-40b0-809b-6f195507f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:05.996170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ed0-7c9c-40b0-809b-6f195507f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.027710 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-57476ed0-7c9c-40b0-809b-6f195507f9b8 None None] MFA Rules not processed for user `ab23179a0de54f999cf0fdc19b298cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:06.028797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-57476ed0-7c9c-40b0-809b-6f195507f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:06.097161 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1457/2919] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:06.101828 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049b1ba-08c7-4363-9426-02bdd9cb31f4 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.165681 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049b1ba-08c7-4363-9426-02bdd9cb31f4 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.170623 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555e83-f15f-41d3-b0a2-a1ee2574b8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.171250 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555e83-f15f-41d3-b0a2-a1ee2574b8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.171533 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555e83-f15f-41d3-b0a2-a1ee2574b8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.171809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13555e83-f15f-41d3-b0a2-a1ee2574b8e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.172463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13555e83-f15f-41d3-b0a2-a1ee2574b8e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.174451 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13555e83-f15f-41d3-b0a2-a1ee2574b8e3 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.202925 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1463/2920] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:55:06 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:06.207228 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476ed0-7c9c-40b0-809b-6f195507f9b8 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.218221 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476ed0-7c9c-40b0-809b-6f195507f9b8 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.251227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:06.279424 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45338c4-b53e-47e1-a9a1-8c29ea40fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.279969 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45338c4-b53e-47e1-a9a1-8c29ea40fac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.280253 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45338c4-b53e-47e1-a9a1-8c29ea40fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.280531 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45338c4-b53e-47e1-a9a1-8c29ea40fac7 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.281393 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45338c4-b53e-47e1-a9a1-8c29ea40fac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.283458 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45338c4-b53e-47e1-a9a1-8c29ea40fac7 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.321319 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1458/2921] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:55:06 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:06.325671 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555e83-f15f-41d3-b0a2-a1ee2574b8e3 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.336249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13555e83-f15f-41d3-b0a2-a1ee2574b8e3 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.341313 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d6d0-f4c6-48b5-bfca-340d250a149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.341993 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d6d0-f4c6-48b5-bfca-340d250a149c admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.342283 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d6d0-f4c6-48b5-bfca-340d250a149c admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.342564 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129d6d0-f4c6-48b5-bfca-340d250a149c admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.343249 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d6d0-f4c6-48b5-bfca-340d250a149c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.344871 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129d6d0-f4c6-48b5-bfca-340d250a149c admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.367838 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1464/2922] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:55:06.369608 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45338c4-b53e-47e1-a9a1-8c29ea40fac7 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.386380 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45338c4-b53e-47e1-a9a1-8c29ea40fac7 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.391212 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941edea-2268-4a98-9eea-1d4f2de9c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.391867 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941edea-2268-4a98-9eea-1d4f2de9c6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.392145 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941edea-2268-4a98-9eea-1d4f2de9c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.392417 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941edea-2268-4a98-9eea-1d4f2de9c6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.393063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941edea-2268-4a98-9eea-1d4f2de9c6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.394712 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941edea-2268-4a98-9eea-1d4f2de9c6f7 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.406353 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1459/2923] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:55:06.411244 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d6d0-f4c6-48b5-bfca-340d250a149c admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.430287 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129d6d0-f4c6-48b5-bfca-340d250a149c admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.435185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff5a74-517f-4b5f-b686-7179736bf8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.435862 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff5a74-517f-4b5f-b686-7179736bf8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.436147 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff5a74-517f-4b5f-b686-7179736bf8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.436423 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff5a74-517f-4b5f-b686-7179736bf8a6 admin admin] PATH_INFO: `/v3/projects/c5685d4576b24b47905ba841b113c917/users/72c520aef73246c18e8994d8f3221def/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.452256 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff5a74-517f-4b5f-b686-7179736bf8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5685d4576b24b47905ba841b113c917, user_id=72c520aef73246c18e8994d8f3221def, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.454981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff5a74-517f-4b5f-b686-7179736bf8a6 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.469539 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1465/2924] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:55:06 2022] PUT /identity/v3/projects/c5685d4576b24b47905ba841b113c917/users/72c520aef73246c18e8994d8f3221def/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:06.482348 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f495-fa19-4e0d-aefd-91a7678b1a45 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.482634 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f495-fa19-4e0d-aefd-91a7678b1a45 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.482912 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f495-fa19-4e0d-aefd-91a7678b1a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.514893 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-e527f495-fa19-4e0d-aefd-91a7678b1a45 None None] MFA Rules not processed for user `72c520aef73246c18e8994d8f3221def`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:06.516132 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-e527f495-fa19-4e0d-aefd-91a7678b1a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:06.585249 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1460/2925] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:06.592074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff5a74-517f-4b5f-b686-7179736bf8a6 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.661854 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff5a74-517f-4b5f-b686-7179736bf8a6 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.667617 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfcc82-e948-4641-a558-f63f772b59fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.668274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfcc82-e948-4641-a558-f63f772b59fb admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.668556 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfcc82-e948-4641-a558-f63f772b59fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.668830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfcc82-e948-4641-a558-f63f772b59fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.669507 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfcc82-e948-4641-a558-f63f772b59fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.671485 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfcc82-e948-4641-a558-f63f772b59fb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.704174 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1466/2926] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:55:06 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:06.710919 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f495-fa19-4e0d-aefd-91a7678b1a45 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.731054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f495-fa19-4e0d-aefd-91a7678b1a45 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.794785 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415eaab-b755-4433-aca1-7b479f1df213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.795414 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eaab-b755-4433-aca1-7b479f1df213 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.795702 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eaab-b755-4433-aca1-7b479f1df213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.795984 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415eaab-b755-4433-aca1-7b479f1df213 admin admin] PATH_INFO: `/v3/users` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.796629 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415eaab-b755-4433-aca1-7b479f1df213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.798633 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415eaab-b755-4433-aca1-7b479f1df213 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.821271 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1461/2927] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:55:06 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:06.825730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfcc82-e948-4641-a558-f63f772b59fb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.837384 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfcc82-e948-4641-a558-f63f772b59fb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.842130 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472d76e-ea0e-483f-bbd6-f0a8d966ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.842753 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d76e-ea0e-483f-bbd6-f0a8d966ab76 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.843037 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d76e-ea0e-483f-bbd6-f0a8d966ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.843315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472d76e-ea0e-483f-bbd6-f0a8d966ab76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.843959 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472d76e-ea0e-483f-bbd6-f0a8d966ab76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.845670 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472d76e-ea0e-483f-bbd6-f0a8d966ab76 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.863096 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1467/2928] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:55:06.867459 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415eaab-b755-4433-aca1-7b479f1df213 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.878289 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415eaab-b755-4433-aca1-7b479f1df213 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.883120 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1edb9-2887-4bf6-a312-de9a960d6582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:06.883792 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1edb9-2887-4bf6-a312-de9a960d6582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:06.884079 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1edb9-2887-4bf6-a312-de9a960d6582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:06.884376 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1edb9-2887-4bf6-a312-de9a960d6582 admin admin] PATH_INFO: `/v3/projects/3694a27cbc1c47f29a46931ef83f5d4b/users/0f0e03f8273343e68926c573de5de8cf/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:06.901203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1edb9-2887-4bf6-a312-de9a960d6582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3694a27cbc1c47f29a46931ef83f5d4b, user_id=0f0e03f8273343e68926c573de5de8cf, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:06.903933 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1edb9-2887-4bf6-a312-de9a960d6582 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:06.919620 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1462/2929] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:55:06 2022] PUT /identity/v3/projects/3694a27cbc1c47f29a46931ef83f5d4b/users/0f0e03f8273343e68926c573de5de8cf/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:06.926166 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472d76e-ea0e-483f-bbd6-f0a8d966ab76 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:06.945155 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472d76e-ea0e-483f-bbd6-f0a8d966ab76 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:06.951192 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:07.019386 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfc9ed-689a-457e-90c9-1a4bdc107e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:07.020017 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfc9ed-689a-457e-90c9-1a4bdc107e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:07.020300 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfc9ed-689a-457e-90c9-1a4bdc107e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:07.020575 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfc9ed-689a-457e-90c9-1a4bdc107e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:07.021312 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfc9ed-689a-457e-90c9-1a4bdc107e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:07.023544 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfc9ed-689a-457e-90c9-1a4bdc107e03 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:07.034668 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1468/2930] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:55:07.039814 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1edb9-2887-4bf6-a312-de9a960d6582 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:07.050304 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1edb9-2887-4bf6-a312-de9a960d6582 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:07.055080 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:07.055734 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:07.056024 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:07.056269 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] PATH_INFO: `/v3/projects/3694a27cbc1c47f29a46931ef83f5d4b/users/0f0e03f8273343e68926c573de5de8cf/roles/740f7ce58cf44605a43cd3f0ba43f384` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:07.058243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3694a27cbc1c47f29a46931ef83f5d4b, user_id=0f0e03f8273343e68926c573de5de8cf, role_id=740f7ce58cf44605a43cd3f0ba43f384)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:07.060922 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:07.064286 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:07.074646 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1463/2931] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:55:07 2022] PUT /identity/v3/projects/3694a27cbc1c47f29a46931ef83f5d4b/users/0f0e03f8273343e68926c573de5de8cf/roles/740f7ce58cf44605a43cd3f0ba43f384 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 03 12:55:07.086558 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d8c3-579c-4907-9370-892c2033d261 None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:07.086842 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d8c3-579c-4907-9370-892c2033d261 None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:07.087120 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d8c3-579c-4907-9370-892c2033d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:07.116588 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-de66d8c3-579c-4907-9370-892c2033d261 None None] MFA Rules not processed for user `0f0e03f8273343e68926c573de5de8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:07.117729 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-de66d8c3-579c-4907-9370-892c2033d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:07.190341 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1469/2932] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:07.202157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:07.203897 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:07.269874 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a2724-6376-438b-b35b-d53696681fd0 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:07.274152 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621cebd-6a20-476a-8383-823c46b3db0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:07.274764 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621cebd-6a20-476a-8383-823c46b3db0d service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:07.275041 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621cebd-6a20-476a-8383-823c46b3db0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:07.275314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621cebd-6a20-476a-8383-823c46b3db0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:07.335846 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621cebd-6a20-476a-8383-823c46b3db0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:07.337303 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621cebd-6a20-476a-8383-823c46b3db0d service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:07.346936 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1464/2933] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:08.859268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66d8c3-579c-4907-9370-892c2033d261 None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:08.860678 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-de66d8c3-579c-4907-9370-892c2033d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:08.872526 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66d8c3-579c-4907-9370-892c2033d261 None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:08.876134 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1af7b-9adf-4f42-90cf-407fc374bd0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:08.876752 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1af7b-9adf-4f42-90cf-407fc374bd0e service cinder] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:08.877019 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1af7b-9adf-4f42-90cf-407fc374bd0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:08.877297 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1af7b-9adf-4f42-90cf-407fc374bd0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:08.935116 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1af7b-9adf-4f42-90cf-407fc374bd0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:08.936463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1af7b-9adf-4f42-90cf-407fc374bd0e service cinder] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:08.945582 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1470/2934] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:09.492526 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621cebd-6a20-476a-8383-823c46b3db0d service cinder] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:09.501215 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621cebd-6a20-476a-8383-823c46b3db0d service cinder] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:09.505354 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00f134-33c8-4702-bfb6-014811575099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:09.505994 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f134-33c8-4702-bfb6-014811575099 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:09.506890 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f134-33c8-4702-bfb6-014811575099 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:09.507170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f134-33c8-4702-bfb6-014811575099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:09.516384 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f134-33c8-4702-bfb6-014811575099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:09.517885 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f134-33c8-4702-bfb6-014811575099 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:09.527925 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1465/2935] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:13.424645 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1af7b-9adf-4f42-90cf-407fc374bd0e service cinder] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:13.456196 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=100 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:13.489456 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1af7b-9adf-4f42-90cf-407fc374bd0e service cinder] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:13.494029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:13.494653 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:13.494932 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:13.495201 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] PATH_INFO: `/v3/users/ab23179a0de54f999cf0fdc19b298cb3` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:13.496304 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab23179a0de54f999cf0fdc19b298cb3)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:13.498236 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:13.545616 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab23179a0de54f999cf0fdc19b298cb3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:13.546274 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab23179a0de54f999cf0fdc19b298cb3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:13.553502 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab23179a0de54f999cf0fdc19b298cb3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:13.554214 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab23179a0de54f999cf0fdc19b298cb3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:13.561332 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab23179a0de54f999cf0fdc19b298cb3'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:13.578583 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1471/2936] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:55:13 2022] DELETE /identity/v3/users/ab23179a0de54f999cf0fdc19b298cb3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:13.583046 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4dba-17e1-45fd-8f70-92bf854975e4 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:13.583540 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4dba-17e1-45fd-8f70-92bf854975e4 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:13.583658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd4dba-17e1-45fd-8f70-92bf854975e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:13.603374 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-b2dd4dba-17e1-45fd-8f70-92bf854975e4 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:13.604586 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b2dd4dba-17e1-45fd-8f70-92bf854975e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:13.663538 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1466/2937] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:13.673268 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:13.674730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:13.733665 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20068efb-7d3b-4dc1-b2b5-bf8d3bde0074 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:13.737210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22af0da-159b-4616-beee-6315adc17014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:13.737845 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22af0da-159b-4616-beee-6315adc17014 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:13.738127 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22af0da-159b-4616-beee-6315adc17014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:13.738402 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22af0da-159b-4616-beee-6315adc17014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:13.747315 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22af0da-159b-4616-beee-6315adc17014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:13.748730 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22af0da-159b-4616-beee-6315adc17014 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:13.758404 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1472/2938] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:14.032129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4dba-17e1-45fd-8f70-92bf854975e4 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:14.033691 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-b2dd4dba-17e1-45fd-8f70-92bf854975e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:14.050191 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd4dba-17e1-45fd-8f70-92bf854975e4 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:14.056990 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:14.057742 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:14.058082 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:14.058227 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] PATH_INFO: `/v3/projects/7b3eca506c6547b582bc5585c3dac56f` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:14.059514 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3eca506c6547b582bc5585c3dac56f)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:14.061324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:14.096209 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:14.109578 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3eca506c6547b582bc5585c3dac56f', 'request_id': 'req-8d705496-4862-4f41-9e31-63e7c2c215e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.118234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3eca506c6547b582bc5585c3dac56f', 'request_id': 'req-8d705496-4862-4f41-9e31-63e7c2c215e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.124733 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3eca506c6547b582bc5585c3dac56f', 'request_id': 'req-8d705496-4862-4f41-9e31-63e7c2c215e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.135841 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] The token cache is being invalidate because project 7b3eca506c6547b582bc5585c3dac56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:55:14.136134 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.136797 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.138324 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1467/2939] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:55:14 2022] DELETE /identity/v3/projects/7b3eca506c6547b582bc5585c3dac56f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:14.142362 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22af0da-159b-4616-beee-6315adc17014 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:14.152012 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22af0da-159b-4616-beee-6315adc17014 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:14.196641 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:14.210115 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:14.210777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:14.211059 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:14.211333 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] PATH_INFO: `/v3/users/72c520aef73246c18e8994d8f3221def` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:14.212462 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c520aef73246c18e8994d8f3221def)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:14.214463 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:14.260469 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c520aef73246c18e8994d8f3221def'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.261114 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c520aef73246c18e8994d8f3221def'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.268760 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c520aef73246c18e8994d8f3221def'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.269412 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c520aef73246c18e8994d8f3221def'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.277640 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c520aef73246c18e8994d8f3221def'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.295700 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1473/2940] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:55:14 2022] DELETE /identity/v3/users/72c520aef73246c18e8994d8f3221def => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:14.572367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:14.574658 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:14.593448 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d705496-4862-4f41-9e31-63e7c2c215e5 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:14.651233 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:14.651869 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:14.652153 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:14.652431 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] PATH_INFO: `/v3/projects/c5685d4576b24b47905ba841b113c917` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:14.653594 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5685d4576b24b47905ba841b113c917)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:14.655527 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:14.723367 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5685d4576b24b47905ba841b113c917', 'request_id': 'req-f8042a9e-8098-4378-b4fa-2251bf2a768a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.731604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5685d4576b24b47905ba841b113c917', 'request_id': 'req-f8042a9e-8098-4378-b4fa-2251bf2a768a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.738020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5685d4576b24b47905ba841b113c917', 'request_id': 'req-f8042a9e-8098-4378-b4fa-2251bf2a768a'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.749117 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] The token cache is being invalidate because project c5685d4576b24b47905ba841b113c917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:55:14.749409 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.750087 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.751604 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1468/2941] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:55:14 2022] DELETE /identity/v3/projects/c5685d4576b24b47905ba841b113c917 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:14.756830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:14.758288 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:14.771185 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abe367-dd11-4c74-bf2c-d62fe01c9abb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:14.828581 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:14.829240 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:14.829542 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:14.829827 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] PATH_INFO: `/v3/users/0f0e03f8273343e68926c573de5de8cf` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:14.830956 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f0e03f8273343e68926c573de5de8cf)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:14.832887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:14.880981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f0e03f8273343e68926c573de5de8cf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.882245 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f0e03f8273343e68926c573de5de8cf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.889121 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f0e03f8273343e68926c573de5de8cf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.889777 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f0e03f8273343e68926c573de5de8cf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.897869 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-781b4ea9-212e-4f18-bfc2-e4f46406b977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f0e03f8273343e68926c573de5de8cf'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:14.903492 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:14.919095 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1474/2942] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:55:14 2022] DELETE /identity/v3/users/0f0e03f8273343e68926c573de5de8cf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:15.195345 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:15.196871 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:15.216217 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8042a9e-8098-4378-b4fa-2251bf2a768a admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:15.273296 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:15.289429 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:15.290170 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.290669 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.290949 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] PATH_INFO: `/v3/projects/3694a27cbc1c47f29a46931ef83f5d4b` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.292126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3694a27cbc1c47f29a46931ef83f5d4b)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:15.294203 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:15.350454 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3694a27cbc1c47f29a46931ef83f5d4b', 'request_id': 'req-54905730-459f-4c30-bfd4-c76e187dd5f9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:15.358880 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3694a27cbc1c47f29a46931ef83f5d4b', 'request_id': 'req-54905730-459f-4c30-bfd4-c76e187dd5f9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:15.366234 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3694a27cbc1c47f29a46931ef83f5d4b', 'request_id': 'req-54905730-459f-4c30-bfd4-c76e187dd5f9'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:15.377020 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] The token cache is being invalidate because project 3694a27cbc1c47f29a46931ef83f5d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:55:15.377305 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:15.378223 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-54905730-459f-4c30-bfd4-c76e187dd5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:15.379725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1469/2943] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:55:15 2022] DELETE /identity/v3/projects/3694a27cbc1c47f29a46931ef83f5d4b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:15.384809 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f541e0-738f-4354-9bfb-cd7dc0abeaec None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.385097 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f541e0-738f-4354-9bfb-cd7dc0abeaec None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.385376 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f541e0-738f-4354-9bfb-cd7dc0abeaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.404748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-c3f541e0-738f-4354-9bfb-cd7dc0abeaec None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:15.405989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-c3f541e0-738f-4354-9bfb-cd7dc0abeaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:15.490748 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1475/2944] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:15.498767 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377118ad-05c8-4672-9b3b-494745a5d4d6 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.499056 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377118ad-05c8-4672-9b3b-494745a5d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.499335 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377118ad-05c8-4672-9b3b-494745a5d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.519262 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-377118ad-05c8-4672-9b3b-494745a5d4d6 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:15.520470 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-377118ad-05c8-4672-9b3b-494745a5d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:15.528902 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1470/2945] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:15.533656 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f541e0-738f-4354-9bfb-cd7dc0abeaec None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:15.546210 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f541e0-738f-4354-9bfb-cd7dc0abeaec None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:15.550981 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:15.551591 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.551899 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.552178 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.552823 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 03 12:55:15.553131 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:15.554773 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:15.566812 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1476/2946] 10.222.0.17 () {58 vars in 1153 bytes} [Mon Oct 3 12:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 03 12:55:15.571243 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377118ad-05c8-4672-9b3b-494745a5d4d6 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:15.581057 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377118ad-05c8-4672-9b3b-494745a5d4d6 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:15.586579 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300a6d-c993-4757-8a27-ab6c931b55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:15.587182 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a6d-c993-4757-8a27-ab6c931b55f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.587464 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a6d-c993-4757-8a27-ab6c931b55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.587738 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300a6d-c993-4757-8a27-ab6c931b55f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.588369 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f300a6d-c993-4757-8a27-ab6c931b55f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:15.590407 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f300a6d-c993-4757-8a27-ab6c931b55f4 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:15.620224 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1471/2947] 10.222.0.17 () {60 vars in 1153 bytes} [Mon Oct 3 12:55:15 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:15.625339 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:15.641761 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120aa9d-b697-44f9-bcd4-7e576e2275c5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:15.705370 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb1a9-c2ee-42a3-ab86-fef903fa7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:15.706013 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb1a9-c2ee-42a3-ab86-fef903fa7cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.706296 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb1a9-c2ee-42a3-ab86-fef903fa7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.706568 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eb1a9-c2ee-42a3-ab86-fef903fa7cdb admin admin] PATH_INFO: `/v3/users` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.707197 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eb1a9-c2ee-42a3-ab86-fef903fa7cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:15.709600 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6eb1a9-c2ee-42a3-ab86-fef903fa7cdb admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:15.731876 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1477/2948] 10.222.0.17 () {60 vars in 1144 bytes} [Mon Oct 3 12:55:15 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 03 12:55:15.736129 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300a6d-c993-4757-8a27-ab6c931b55f4 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:15.746487 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300a6d-c993-4757-8a27-ab6c931b55f4 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:15.751016 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b485d4-0186-40b5-9e5a-3610ccfd9e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:15.751607 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b485d4-0186-40b5-9e5a-3610ccfd9e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.751886 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b485d4-0186-40b5-9e5a-3610ccfd9e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.752157 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b485d4-0186-40b5-9e5a-3610ccfd9e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.753054 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b485d4-0186-40b5-9e5a-3610ccfd9e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:15.754660 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b485d4-0186-40b5-9e5a-3610ccfd9e2d admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:15.764541 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1472/2949] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 03 12:55:15.768939 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb1a9-c2ee-42a3-ab86-fef903fa7cdb admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:15.780306 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eb1a9-c2ee-42a3-ab86-fef903fa7cdb admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:15.784973 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21706d6c-47e3-495b-b1c2-02a28dc3dbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:15.785606 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706d6c-47e3-495b-b1c2-02a28dc3dbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.785890 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706d6c-47e3-495b-b1c2-02a28dc3dbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.786172 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21706d6c-47e3-495b-b1c2-02a28dc3dbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.786841 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21706d6c-47e3-495b-b1c2-02a28dc3dbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:15.789049 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21706d6c-47e3-495b-b1c2-02a28dc3dbc7 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:15.799818 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1478/2950] 10.222.0.17 () {58 vars in 1122 bytes} [Mon Oct 3 12:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 03 12:55:15.803812 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b485d4-0186-40b5-9e5a-3610ccfd9e2d admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:15.814001 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b485d4-0186-40b5-9e5a-3610ccfd9e2d admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:15.818781 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:15.819430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.819715 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.819996 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] PATH_INFO: `/v3/projects/8ae82c587a01407dbea15f61f741b243/users/3289b76ecb0a4551a4485187654592ec/roles/ee1e03b1c7fc49c59595ac9b72bea8ba` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.835143 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae82c587a01407dbea15f61f741b243, user_id=3289b76ecb0a4551a4485187654592ec, role_id=ee1e03b1c7fc49c59595ac9b72bea8ba)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:15.837824 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:15.852396 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1473/2951] 10.222.0.17 () {60 vars in 1483 bytes} [Mon Oct 3 12:55:15 2022] PUT /identity/v3/projects/8ae82c587a01407dbea15f61f741b243/users/3289b76ecb0a4551a4485187654592ec/roles/ee1e03b1c7fc49c59595ac9b72bea8ba => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:15.864226 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ebb6-5225-4531-8509-9fc31051071b None None] REQUEST_METHOD: `POST` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:15.864519 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ebb6-5225-4531-8509-9fc31051071b None None] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:15.864830 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658ebb6-5225-4531-8509-9fc31051071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:15.893293 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.auth.core [None req-a658ebb6-5225-4531-8509-9fc31051071b None None] MFA Rules not processed for user `3289b76ecb0a4551a4485187654592ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:15.894561 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-a658ebb6-5225-4531-8509-9fc31051071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:15.937490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:15.962052 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1479/2952] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:15.973430 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:15.975252 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:16.033052 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8e55b-56ef-4b0c-8e42-c1c5f6a470c8 admin admin] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:16.036667 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c78453-d777-4645-9722-71b3c5b66fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e81eb41d8264474917e3b4f3fa2becd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:16.037294 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78453-d777-4645-9722-71b3c5b66fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:16.037616 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78453-d777-4645-9722-71b3c5b66fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:16.037899 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78453-d777-4645-9722-71b3c5b66fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:16.048098 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c78453-d777-4645-9722-71b3c5b66fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:16.049990 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c78453-d777-4645-9722-71b3c5b66fc7 service cinder] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:16.065126 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1474/2953] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:21.072804 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658ebb6-5225-4531-8509-9fc31051071b None None] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:21.136605 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658ebb6-5225-4531-8509-9fc31051071b None None] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:21.141103 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:21.141768 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:21.142050 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:21.142324 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] PATH_INFO: `/v3/users/3289b76ecb0a4551a4485187654592ec` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:21.143443 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3289b76ecb0a4551a4485187654592ec)` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:21.145432 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:21.192968 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3289b76ecb0a4551a4485187654592ec'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.194184 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3289b76ecb0a4551a4485187654592ec'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.201625 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3289b76ecb0a4551a4485187654592ec'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.202286 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3289b76ecb0a4551a4485187654592ec'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.210309 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.notifications [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3289b76ecb0a4551a4485187654592ec'} {{(pid=81412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.227989 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1480/2954] 10.222.0.17 () {58 vars in 1224 bytes} [Mon Oct 3 12:55:21 2022] DELETE /identity/v3/users/3289b76ecb0a4551a4485187654592ec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:21.232657 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364cd17-4079-4e3e-9fa9-59eeec0c56e9 None None] REQUEST_METHOD: `POST` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:21.233204 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364cd17-4079-4e3e-9fa9-59eeec0c56e9 None None] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:21.233314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364cd17-4079-4e3e-9fa9-59eeec0c56e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:21.252976 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.auth.core [None req-8364cd17-4079-4e3e-9fa9-59eeec0c56e9 None None] MFA Rules not processed for user `47b8fe7c355f40a8aebb0296c911e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=81413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 03 12:55:21.254314 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8364cd17-4079-4e3e-9fa9-59eeec0c56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:21.267920 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:21.319029 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1475/2955] 10.222.0.17 () {58 vars in 958 bytes} [Mon Oct 3 12:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 03 12:55:21.328782 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:21.330251 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:21.386754 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386774-cd42-4092-90ac-23a0dd7653a5 admin admin] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:21.390895 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '323b7d02f817475791098f32bf1c953e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:21.391490 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:21.391770 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:21.392041 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:21.401538 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:21.402988 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:21.412508 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1481/2956] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:55:21.669992 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364cd17-4079-4e3e-9fa9-59eeec0c56e9 None None] Authenticating user token {{(pid=81413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:55:21.671467 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.fernet_utils [None req-8364cd17-4079-4e3e-9fa9-59eeec0c56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:55:21.685725 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364cd17-4079-4e3e-9fa9-59eeec0c56e9 None None] Validating token access rules against request {{(pid=81413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:55:21.691309 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47b8fe7c355f40a8aebb0296c911e10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55a504954dfa4713bb307e2b5ecea75a', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:55:21.692040 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:55:21.693076 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:55:21.694063 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] PATH_INFO: `/v3/projects/8ae82c587a01407dbea15f61f741b243` {{(pid=81413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:55:21.696068 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae82c587a01407dbea15f61f741b243)` {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:55:21.698613 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] RBAC: Authorization granted {{(pid=81413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:55:21.748989 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae82c587a01407dbea15f61f741b243', 'request_id': 'req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.757027 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae82c587a01407dbea15f61f741b243', 'request_id': 'req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.763308 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae82c587a01407dbea15f61f741b243', 'request_id': 'req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5'} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.773929 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] The token cache is being invalidate because project 8ae82c587a01407dbea15f61f741b243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 03 12:55:21.774207 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.774861 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG keystone.notifications [None req-efe9d1c1-799f-4df1-a3a9-486cce4db0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 03 12:55:21.776451 dv-cinder-844563-12-smb devstack@keystone.service[81413]: [pid: 81413|app: 0|req: 1476/2957] 10.222.0.17 () {58 vars in 1233 bytes} [Mon Oct 3 12:55:21 2022] DELETE /identity/v3/projects/8ae82c587a01407dbea15f61f741b243 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 03 12:55:31.408234 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:55:31.770585 dv-cinder-844563-12-smb devstack@keystone.service[81413]: DEBUG dbcounter [-] [81413] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 03 12:58:21.124547 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] Authenticating user token {{(pid=81412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 03 12:58:21.125965 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:58:21.266629 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb80957-1571-46f5-a554-98bf3ab001d3 service neutron] Validating token access rules against request {{(pid=81412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 03 12:58:21.325892 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e8a10-4e72-4d47-a12a-82b6e9809816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0886bba187b4d608cea7dcffed2c2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbb691badbf41cdaf8be15693336c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 03 12:58:21.326500 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8a10-4e72-4d47-a12a-82b6e9809816 service placement] REQUEST_METHOD: `GET` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 03 12:58:21.326780 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8a10-4e72-4d47-a12a-82b6e9809816 service placement] SCRIPT_NAME: `/identity` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 03 12:58:21.327074 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8a10-4e72-4d47-a12a-82b6e9809816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 03 12:58:21.328887 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.fernet_utils [None req-e11e8a10-4e72-4d47-a12a-82b6e9809816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 03 12:58:21.340445 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8a10-4e72-4d47-a12a-82b6e9809816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 03 12:58:21.342029 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8a10-4e72-4d47-a12a-82b6e9809816 service placement] RBAC: Authorization granted {{(pid=81412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 03 12:58:21.352319 dv-cinder-844563-12-smb devstack@keystone.service[81412]: [pid: 81412|app: 0|req: 1482/2958] 10.222.0.17 () {60 vars in 1365 bytes} [Mon Oct 3 12:58:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 03 12:58:31.348022 dv-cinder-844563-12-smb devstack@keystone.service[81412]: DEBUG dbcounter [-] [81412] Writing DB stats keystone:SELECT=89 {{(pid=81412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}